00000001:02000400:3.0F:1787864517.548749:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787864533.380423:0:3513:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787864535.224260:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 867 MB/s 00000001:01000000:0.0:1787864535.474257:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 571 MB/s 00000001:01000000:3.0:1787864535.723992:0:3573:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5619 MB/s 00000020:02000000:2.0:1787864536.385089:0:3605:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_gb165317 00000400:02000000:0.0:1787864537.600110:0:3621:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.136@tcp [8/256/0/180] 00008000:02000000:2.0:1787864541.635577:0:3770:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787864597.027753:0:5738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787864608.988438:0:6488:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787864608.988444:0:6488:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787864608.988446:0:6488:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787864608.988570:0:6488:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000358d321c 00000080:02000400:0.0:1787864608.988579:0:6488:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787864608.996189:0:6488:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787864608.996202:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787864608.996811:0:6488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006805fea5) 00000020:00000080:3.0:1787864608.996830:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0F:1787864609.073269:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787864609.073946:0:6488:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1787864609.100373:0:6488:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787864609.100577:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787864609.100585:0:6488:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787864609.100597:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42d9c 00000020:01000004:1.0:1787864609.100603:0:6488:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787864609.100607:0:6488:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787864609.100611:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000358d321c from MGS 00000020:01000004:1.0:1787864609.100615:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787864609.100633:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f3ca9a16) 00000020:00000080:1.0:1787864609.100644:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787864609.100724:0:6488:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000358d321c from MGS, refs=2 00080000:01000000:1.0:1787864609.100729:0:6488:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787864609.100735:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42daa 00000100:00100000:1.0:1787864609.100833:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787864609.101232:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787864609.101239:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787864609.105829:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787864609.106145:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787864609.107061:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864609.107225:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787864609.107231:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787864609.114739:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787864609.114754:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787864609.115253:0:6488:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787864609.115260:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787864609.116655:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864609.116661:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864609.116662:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864609.116907:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864609.116910:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864609.116911:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864609.117716:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787864609.122106:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787864609.367323:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2399 MB/s 00000001:01000000:0.0:1787864609.617027:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4679 MB/s 00000001:01000000:2.0:1787864609.868133:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 621 MB/s 00000001:01000000:3.0:1787864610.120095:0:6488:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 412 MB/s 00080000:10000000:3.0:1787864610.130471:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1787864610.137148:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787864610.167257:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787864610.168505:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787864610.168563:0:6488:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787864610.168605:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787864610.168776:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787864610.168815:0:6488:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787864610.169167:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864610.169301:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787864610.169307:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787864610.171237:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787864610.171248:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787864610.172999:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787864610.173011:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787864610.173703:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787864610.173723:0:6488:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.136@tcp' 00000020:01000004:1.0:1787864610.173725:0:6488:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787864610.173776:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.136@tcp (typ=mgc) 00000020:00000080:1.0:1787864610.173787:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.136@tcp (0000000088c8b00e) 00000020:00000080:1.0:1787864610.173812:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787864610.173932:0:6488:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c71fc110@MGC192.168.206.136@tcp: add connection 192.168.206.136@tcp at head 00010000:00010000:1.0:1787864610.174085:0:6488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.136@tcp-0 is initialized 00000040:01000000:1.0:1787864610.174092:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787864610.174235:0:6506:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787864610.189337:0:6508:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787864610.189405:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.136@tcp (uuid 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f) 00000020:00000080:2.0:1787864610.189428:0:6488:0:(genops.c:1385:class_connect()) connect: client 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f, cookie 0x2fcb8c294dc42db8 00000100:00080000:2.0:1787864610.189439:0:6488:0:(import.c:510:import_select_connection()) MGC192.168.206.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864610.189444:0:6488:0:(import.c:624:import_select_connection()) MGC192.168.206.136@tcp: import 00000000c71fc110 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864610.189476:0:6488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008183b4b9 x1874711844749440/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864610.189782:0:6488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS 00000020:01000004:2.0:1787864610.189812:0:6488:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787864610.189841:0:6488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787864610.189863:0:6488:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004395ccdb) 00000020:00000080:2.0:1787864610.189876:0:6488:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787864610.190641:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844749440:0@lo:250: 00000100:00100000:1.0:1787864610.190821:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864610.193066:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844749440 00000100:00100000:0.0:1787864610.193078:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844749440 00000100:00100000:0.0:1787864610.193124:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864610.193131:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb939307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1874711844749440:12345-0@lo:250: 00010000:00080000:0.0:1787864610.193157:0:6503:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:0.0:1787864610.193184:0:6503:0:(genops.c:1385:class_connect()) connect: client 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f, cookie 0x2fcb8c294dc42dc6 00000100:00080000:0.0:1787864610.193298:0:6503:0:(import.c:65:import_set_state_nolock()) 00000000606578cf : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864610.193395:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb939307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:3636:x1874711844749440:12345-0@lo:250: Request processed in 263us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864610.193403:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864610.194661:0:3636:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787864610.194675:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.136@tcp: connect to target with instance 0 00000100:00080000:1.0:1787864610.195585:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787864610.195595:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787864610.195600:0:3636:0:(import.c:65:import_set_state_nolock()) 00000000c71fc110 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787864610.195605:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787864610.195618:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787864610.195625:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844749440:0@lo:250: 00000100:00100000:2.0:1787864610.223248:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864610.223429:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787864610.223435:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787864610.225804:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787864610.225817:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787864610.226416:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787864610.226424:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787864610.228360:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787864610.228635:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787864610.228641:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787864610.231781:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787864610.231803:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787864610.379407:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864610.387041:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787864610.387050:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787864610.390258:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787864610.390272:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787864610.409085:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864610.409272:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787864610.409278:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787864610.413113:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787864610.413127:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787864610.413719:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864610.414116:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787864610.414123:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787864610.417318:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787864610.417331:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787864610.419471:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864610.419660:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787864610.419666:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787864610.421346:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787864610.421356:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787864610.446494:0:6488:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787864610.447132:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787864610.447149:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787864610.450942:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787864610.450957:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787864610.454133:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787864610.454148:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787864610.457477:0:6488:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787864610.457508:0:6488:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787864610.457515:0:6488:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787864610.457613:0:6488:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787864610.457646:0:6488:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.136@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787864610.457651:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787864610.457653:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787864610.457654:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864610.457656:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864610.457657:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864610.457662:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864610.457663:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864610.457665:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787864610.457666:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864610.457667:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864610.457669:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864610.457670:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787864610.457672:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787864610.457674:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787864610.457675:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787864610.457676:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864610.457677:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864610.457678:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864610.457679:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864610.457679:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864610.457680:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787864610.457760:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864610.457762:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864610.457763:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864610.457764:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787864610.458226:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787864610.458247:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749568:0@lo:253: 00000100:00100000:1.0:1787864610.458311:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.458406:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2225d0d going to sleep for 11 seconds 00000100:00100000:0.0:1787864610.458482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844749568 00000100:00100000:0.0:1787864610.458489:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844749568 00000100:00100000:0.0:1787864610.458572:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864610.458581:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed0633eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6488:x1874711844749568:12345-0@lo:253: 20000000:01000000:0.0:1787864610.458632:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787864610.458635:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787864610.461481:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787864610.461541:0:6505:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787864610.461877:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864610.467336:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787864610.467815:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787864610.467819:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787864610.467825:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787864610.467827:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787864610.467840:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787864610.468428:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864610.468603:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787864610.468618:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787864610.468636:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787864610.468651:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787864610.468665:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787864610.468816:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787864610.468824:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787864610.468835:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787864610.468839:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787864610.468850:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787864610.468854:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787864610.468864:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787864610.468876:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787864610.469135:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787864610.469142:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787864610.469150:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864610.469260:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787864610.469270:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787864610.469297:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787864610.469311:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787864610.469322:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787864610.469331:0:6505:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787864610.469354:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787864610.469362:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787864610.469372:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787864610.469385:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787864610.469397:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787864610.469404:0:6505:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787864610.469422:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787864610.469428:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787864610.469438:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787864610.469450:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787864610.469508:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787864610.469529:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787864610.469535:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787864610.470279:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787864610.470464:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787864610.470483:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.136@tcp for mdt 20000000:01000000:0.0:1787864610.470491:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787864610.470506:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787864610.470511:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787864610.470522:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787864610.470526:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:0.0:1787864610.470536:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787864610.470541:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787864610.470551:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787864610.470563:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787864610.470584:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787864610.470587:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787864610.470590:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787864610.470623:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787864610.470624:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787864610.475693:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787864610.476055:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787864610.476083:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787864610.476100:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787864610.476114:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787864610.476116:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787864610.494370:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787864610.494630:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787864610.494656:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787864610.494669:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787864610.494692:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787864610.494694:0:6505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787864610.494699:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787864610.494701:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787864610.494706:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787864610.494712:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787864610.495121:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1787864610.495291:0:6505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787864610.507133:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787864610.507167:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787864610.507179:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787864610.507196:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787864610.507215:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507231:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507240:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507257:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507262:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507267:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507272:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069fc14a5 already unused, calling callback (000000001adf2aa7) 00010000:00010000:0.0:1787864610.507275:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507283:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507363:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507371:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.507376:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42dcd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787864610.507392:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787864610.522751:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed0633eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6488:x1874711844749568:12345-0@lo:253: Request processed in 64152us (64420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864610.522766:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864610.524033:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749568:0@lo:253: 10000000:01000000:1.0:1787864610.524052:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787864610.524056:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787864610.524057:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787864610.524058:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864610.524060:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787864610.524061:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864610.524062:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864610.524063:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864610.524065:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787864610.524066:0:6488:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787864610.524067:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864610.524069:0:6488:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787864610.524088:0:6488:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000358d321c from lustre-MDT0000 10000000:01000000:1.0:1787864610.524116:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787864610.524119:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787864610.524123:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92755ed9ced8 10000000:01000000:1.0:1787864610.524127:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864610.524136:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92755ed9ced8 from 1 10000000:01000000:1.0:1787864610.524139:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787864610.524174:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.524185:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.524193:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864610.524223:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749696:0@lo:101: 00000100:00100000:1.0:1787864610.524274:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.524352:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:0.0:1787864610.524359:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844749696 00000100:00100000:0.0:1787864610.524373:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844749696 00000100:00100000:0.0:1787864610.524425:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864610.524433:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000431e834c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6488:x1874711844749696:12345-0@lo:101: 00010000:00010000:0.0:1787864610.524447:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864610.524459:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42dd4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.524483:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.524493:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.524502:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069fc14a5, rc 0) 00000100:00100000:0.0:1787864610.524558:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000431e834c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6488:x1874711844749696:12345-0@lo:101: Request processed in 127us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864610.524565:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864610.525014:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749696:0@lo:101: 00010000:00010000:1.0:1787864610.525030:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.525040:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864610.525097:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749824:0@lo:501: 00000100:00100000:1.0:1787864610.525127:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.525156:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:0.0:1787864610.525324:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844749824 00000100:00100000:0.0:1787864610.525330:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844749824 00000100:00100000:0.0:1787864610.525367:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864610.525373:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000256648a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6488:x1874711844749824:12345-0@lo:501: 00000100:00100000:0.0:1787864610.525464:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000256648a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6488:x1874711844749824:12345-0@lo:501: Request processed in 91us (337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864610.525471:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864610.526017:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749824:0@lo:501: 10000000:01000000:1.0:1787864610.526046:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787864610.526068:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.526076:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864610.526084:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff927548600000 10000000:01000000:1.0:1787864610.526090:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787864610.526094:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff927548600000 10000000:01000000:1.0:1787864610.526097:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787864610.526100:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff927548600000 from 1 10000000:01000000:1.0:1787864610.526103:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787864610.526122:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.526129:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.526144:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864610.526158:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749952:0@lo:101: 00000100:00100000:1.0:1787864610.526190:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.526820:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.527817:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844749952 00000100:00100000:2.0:1787864610.527827:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844749952 00000100:00100000:2.0:1787864610.527874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787864610.527883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091f0d150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6488:x1874711844749952:12345-0@lo:101: 00010000:00010000:2.0:1787864610.527913:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864610.527930:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8f01fd8/0x2fcb8c294dc42de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42de2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.527966:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8f01fd8/0x2fcb8c294dc42de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42de2 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.527976:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8f01fd8/0x2fcb8c294dc42de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42de2 expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.527984:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8f01fd8, rc 0) 00000100:00100000:2.0:1787864610.528047:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091f0d150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+7:6488:x1874711844749952:12345-0@lo:101: Request processed in 166us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.528054:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864610.530414:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844749952:0@lo:101: 00010000:00010000:1.0:1787864610.530443:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.530456:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864610.530475:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787864610.530484:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.530490:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 000000001a56bfbb/0x2fcb8c294dc42de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864610.530497:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787864610.530505:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864610.530510:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff927548600000 10000000:01000000:1.0:1787864610.530512:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787864610.530516:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787864610.530518:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787864610.530547:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.530567:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.530575:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864610.530594:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750080:0@lo:101: 00000100:00100000:1.0:1787864610.530649:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.530710:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.531991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750080 00000100:00100000:2.0:1787864610.532004:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750080 00000100:00100000:2.0:1787864610.532066:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864610.532086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bec4c758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+7:6488:x1874711844750080:12345-0@lo:101: 00010000:00010000:2.0:1787864610.532102:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864610.532116:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42df0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.532137:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.532146:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.532154:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000247f88d6, rc 0) 00000100:00100000:2.0:1787864610.532223:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bec4c758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+8:6488:x1874711844750080:12345-0@lo:101: Request processed in 137us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.532230:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864610.532333:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750080:0@lo:101: 00010000:00010000:1.0:1787864610.532347:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.532356:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864610.532415:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750208:0@lo:501: 00000100:00100000:1.0:1787864610.532442:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.532474:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.532536:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750208 00000100:00100000:2.0:1787864610.532540:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750208 00000100:00100000:2.0:1787864610.532566:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864610.532572:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3effe1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+8:6488:x1874711844750208:12345-0@lo:501: 00000100:00100000:2.0:1787864610.532690:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3effe1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6488:x1874711844750208:12345-0@lo:501: Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.532696:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864610.532870:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750208:0@lo:501: 00000100:00100000:1.0:1787864610.532925:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750336:0@lo:503: 00000100:00100000:1.0:1787864610.532973:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.532997:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071b9a89d going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.533087:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750336 00000100:00100000:2.0:1787864610.533092:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750336 00000100:00100000:2.0:1787864610.533113:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864610.533118:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c31fd1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6488:x1874711844750336:12345-0@lo:503: 00000100:00100000:2.0:1787864610.533215:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c31fd1cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6488:x1874711844750336:12345-0@lo:503: Request processed in 96us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.533230:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864610.533476:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003b5f300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750336:0@lo:503: 00000100:00100000:0.0:1787864610.533936:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6532:1874711844750464:0@lo:502: 00000100:00100000:0.0:1787864610.533992:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864610.534023:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 00000000473ed796 going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.534157:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750464 00000100:00100000:2.0:1787864610.534162:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750464 00000100:00100000:2.0:1787864610.534207:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864610.534214:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1f551ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6532:x1874711844750464:12345-0@lo:502: 00000100:00100000:2.0:1787864610.534303:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1f551ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6532:x1874711844750464:12345-0@lo:502: Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.534310:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864610.534432:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6532:1874711844750464:0@lo:502: 00000020:01000000:0.0:1787864610.534463:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864610.534473:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.534476:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787864610.534481:0:6532:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787864610.534484:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864610.534506:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ef9b4eb0) 00000020:00000080:0.0:1787864610.534522:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787864610.534528:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787864610.534653:0:6532:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787864610.534661:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42e05 00000020:00000080:0.0:1787864610.534920:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787864610.534925:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864610.534929:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.534931:0:6532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787864610.534933:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864610.534937:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.534938:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787864610.534941:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864610.534946:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004baf88d4) 00000020:00000080:0.0:1787864610.534966:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787864610.534970:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787864610.534972:0:6532:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787864610.534974:0:6532:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787864610.534980:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787864610.535025:0:6532:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000358d321c from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787864610.535036:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a9e6d11b) 00000020:00000080:0.0:1787864610.535043:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787864610.535102:0:6532:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787864610.535108:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc42e1a 00000020:00000080:0.0:1787864610.535187:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787864610.535193:0:6532:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787864610.535196:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2fcb8c294dc42e21 00080000:01000000:0.0:1787864610.535200:0:6532:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787864610.535209:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42e28 00080000:10000000:0.0:1787864610.535580:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1787864610.535750:0:6532:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787864610.543519:0:6532:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787864610.685147:0:6532:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787864610.686190:0:6532:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787864610.692174:0:6532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787864610.693445:0:6532:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787864610.696823:0:6532:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000049989db3) 00000020:00000080:0.0:1787864610.696842:0:6532:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787864610.697174:0:6532:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787864610.697183:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42e36 00000020:00000080:3.0:1787864610.704288:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787864610.705673:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1787864610.710563:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1787864610.713417:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1787864610.715659:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1787864610.725366:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1787864610.735578:0:6532:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1787864610.739559:0:6532:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2fcb8c294dc42e3d 00000020:00000080:0.0:1787864610.740248:0:6532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787864610.740260:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864610.740266:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.740268:0:6532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787864610.740271:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864610.740275:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.740277:0:6532:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787864610.740280:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787864610.740281:0:6532:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787864610.740283:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864610.740285:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.740286:0:6532:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787864610.740288:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864610.740293:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864610.740294:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787864610.740298:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787864610.740338:0:6532:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787864610.740389:0:6532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6532:1874711844750592:0@lo:502: 00000100:00100000:0.0:1787864610.740464:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864610.740522:0:6532:0:(client.c:2715:ptlrpc_set_wait()) set 000000002af9fb5b going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.740577:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750592 00000100:00100000:2.0:1787864610.740584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750592 00000100:00100000:2.0:1787864610.740645:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864610.740653:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070e8d4c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6532:x1874711844750592:12345-0@lo:502: 00000100:00100000:2.0:1787864610.740773:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070e8d4c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6532:x1874711844750592:12345-0@lo:502: Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.740780:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864610.740914:0:6532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6532:1874711844750592:0@lo:502: 00000020:01000000:3.0:1787864610.740940:0:6532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864610.740945:0:6532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864610.740947:0:6532:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787864610.740950:0:6532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787864610.741280:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787864610.741302:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787864610.741324:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.741335:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864610.741352:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927548600000 from 1 10000000:01000000:2.0:1787864610.741355:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864610.741385:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.741392:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.741400:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.741416:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750720:0@lo:101: 00000100:00100000:2.0:1787864610.741450:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.741473:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d4a56c3 going to sleep for 11 seconds 00000100:00100000:3.0:1787864610.741530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750720 00000100:00100000:3.0:1787864610.741536:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750720 00000100:00100000:3.0:1787864610.741572:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787864610.741578:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c540ed1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:6488:x1874711844750720:12345-0@lo:101: 00010000:00010000:3.0:1787864610.741587:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864610.741599:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42e44 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864610.741630:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864610.741640:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864610.741657:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eca4e19c, rc 0) 00000100:00100000:3.0:1787864610.741708:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c540ed1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:6488:x1874711844750720:12345-0@lo:101: Request processed in 130us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864610.741714:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864610.741927:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750720:0@lo:101: 00010000:00010000:2.0:1787864610.741939:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.741947:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.743820:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750848:0@lo:256: 00000100:00100000:2.0:1787864610.744273:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.744313:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d4a56c3 going to sleep for 11 seconds 00000100:00100000:3.0:1787864610.744816:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750848 00000100:00100000:3.0:1787864610.744824:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750848 00000100:00100000:3.0:1787864610.744871:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864610.744912:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009da10221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:6488:x1874711844750848:12345-0@lo:256: 20000000:01000000:3.0:1787864610.744937:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787864610.744943:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787864610.745215:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009da10221 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:6488:x1874711844750848:12345-0@lo:256: Request processed in 336us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864610.745222:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864610.745303:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750848:0@lo:256: 10000000:01000000:2.0:1787864610.747311:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864610.747397:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.747423:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864610.747432:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927548600000 from 1 10000000:01000000:2.0:1787864610.747434:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864610.747472:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.747479:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.747488:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.747508:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750976:0@lo:101: 00000100:00100000:2.0:1787864610.747571:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.747630:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d4a56c3 going to sleep for 11 seconds 00000100:00100000:1.0:1787864610.749961:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844750976 00000100:00100000:1.0:1787864610.749975:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844750976 00000100:00100000:1.0:1787864610.750039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864610.750048:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b09f8189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:6488:x1874711844750976:12345-0@lo:101: 00010000:00010000:1.0:1787864610.750064:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864610.750082:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42e52 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.750106:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.750116:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.750124:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044cd55d1, rc 0) 00000100:00100000:1.0:1787864610.750198:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b09f8189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844750976:12345-0@lo:101: Request processed in 151us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864610.750205:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864610.750319:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844750976:0@lo:101: 00010000:00010000:2.0:1787864610.750336:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.750344:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.750411:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751104:0@lo:501: 00000100:00100000:2.0:1787864610.750444:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.750484:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d4a56c3 going to sleep for 11 seconds 00000100:00100000:1.0:1787864610.751050:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751104 00000100:00100000:1.0:1787864610.751056:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751104 00000100:00100000:1.0:1787864610.751086:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787864610.751092:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b7e116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844751104:12345-0@lo:501: 00000100:00100000:1.0:1787864610.751260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b7e116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844751104:12345-0@lo:501: Request processed in 168us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864610.751267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864610.751408:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751104:0@lo:501: 00000100:00100000:3.0:1787864610.751447:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751232:0@lo:503: 00000100:00100000:3.0:1787864610.751493:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864610.751524:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000671eb0d7 going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.751571:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751232 00000100:00100000:2.0:1787864610.751576:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751232 00000100:00100000:2.0:1787864610.751607:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864610.751627:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008abc33a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844751232:12345-0@lo:503: 00000040:00080000:2.0:1787864610.751658:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864610.751704:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008abc33a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844751232:12345-0@lo:503: Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.751710:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864610.751919:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751232:0@lo:503: 00000040:00080000:3.0:1787864610.753595:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787864610.754256:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787864610.754279:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864610.758345:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.758363:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864610.758456:0:6488:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787864610.758459:0:6488:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff927548600000 10000000:01000000:2.0:1787864610.758461:0:6488:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff927548600000 10000000:01000000:2.0:1787864610.758465:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864610.758471:0:6488:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927548600000 from 1 10000000:01000000:2.0:1787864610.758474:0:6488:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864610.758508:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.758515:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.758525:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.758555:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751360:0@lo:101: 00000100:00100000:2.0:1787864610.758803:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.758933:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 00000000648f5f62 going to sleep for 11 seconds 00000100:00100000:1.0:1787864610.759349:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751360 00000100:00100000:1.0:1787864610.759356:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751360 00000100:00100000:0.0:1787864610.759517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864610.759525:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b668d8f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6488:x1874711844751360:12345-0@lo:101: 00010000:00010000:0.0:1787864610.759541:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864610.759554:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42e60 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.759577:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.759586:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.759594:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000ef53c24, rc 0) 00000100:00100000:0.0:1787864610.759662:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b668d8f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844751360:12345-0@lo:101: Request processed in 138us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864610.759669:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787864610.759736:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fda5818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751360:0@lo:101: 00010000:00010000:3.0:1787864610.759751:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864610.759759:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864610.759840:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751488:0@lo:501: 00000100:00100000:3.0:1787864610.759868:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864610.760348:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000002476060f going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.760422:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751488 00000100:00100000:2.0:1787864610.760427:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751488 00000100:00100000:2.0:1787864610.760456:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864610.760462:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029b549b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844751488:12345-0@lo:501: 00000100:00100000:2.0:1787864610.760584:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029b549b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844751488:12345-0@lo:501: Request processed in 122us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.760591:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787864610.760940:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751488:0@lo:501: 00000100:00100000:3.0:1787864610.760988:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751616:0@lo:503: 00000100:00100000:3.0:1787864610.761032:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864610.761049:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 000000002476060f going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.761208:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751616 00000100:00100000:2.0:1787864610.761212:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751616 00000100:00100000:2.0:1787864610.761236:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864610.761242:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000332c4081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844751616:12345-0@lo:503: 00000100:00100000:2.0:1787864610.761329:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000332c4081 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844751616:12345-0@lo:503: Request processed in 86us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.761336:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787864610.761452:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844751616:0@lo:503: 00000100:00100000:3.0:1787864610.762150:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6537:1874711844751744:0@lo:502: 00000100:00100000:3.0:1787864610.762198:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864610.762234:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bec25892 going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.762323:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751744 00000100:00100000:2.0:1787864610.762328:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751744 00000100:00100000:2.0:1787864610.762364:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864610.762371:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a85715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6537:x1874711844751744:12345-0@lo:502: 00000100:00100000:2.0:1787864610.762462:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a85715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6537:x1874711844751744:12345-0@lo:502: Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.762468:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864610.762577:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6537:1874711844751744:0@lo:502: 00000020:01000004:3.0:1787864610.763124:0:6537:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787864610.763139:0:6537:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000068f09d2e) 00000020:00000080:3.0:1787864610.763160:0:6537:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787864610.763255:0:6537:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000358d321c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787864610.763259:0:6537:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000358d321c from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787864610.763261:0:6537:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000358d321c 4 00010000:00080000:3.0:1787864610.763295:0:6537:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000053779d11@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864610.766475:0:6537:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787864610.766659:0:6537:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787864610.766698:0:6537:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787864610.766708:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2fcb8c294dc42e75 00000100:00080000:3.0:1787864610.766716:0:6537:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864610.766721:0:6537:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000053779d11 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864610.766753:0:6537:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003e4c0404 x1874711844751872/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864610.766770:0:6537:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787864610.768699:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844751872:0@lo:38: 00000100:00100000:1.0:1787864610.768767:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.768858:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844751872 00000100:00100000:1.0:1787864610.768865:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844751872 00000100:00100000:1.0:1787864610.768919:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864610.768925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003b5f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844751872:12345-0@lo:38: 00000100:00100000:3.0:1787864610.769246:0:6537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6537:1874711844752000:0@lo:502: 00000100:00100000:3.0:1787864610.769292:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864610.769318:0:6537:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b6a909ec going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.769514:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752000 00000100:00100000:2.0:1787864610.769518:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752000 00000100:00100000:2.0:1787864610.769567:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864610.769578:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd3cd9a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6537:x1874711844752000:12345-0@lo:502: 00000100:00100000:2.0:1787864610.769680:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd3cd9a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6537:x1874711844752000:12345-0@lo:502: Request processed in 108us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.769687:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864610.771092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003b5f300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844751872:12345-0@lo:38: Request processed in 2162us (2321us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787864610.771105:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864610.771161:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864610.771169:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000053779d11 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864610.771173:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787864610.771176:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e4c0404 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844751872:0@lo:38: 00000100:00100000:3.0:1787864610.771295:0:6537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6537:1874711844752000:0@lo:502: 00000040:00080000:3.0:1787864610.771328:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787864610.771481:0:6488:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787864610.771501:0:6488:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787864610.771552:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.771564:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787864610.771620:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787864610.771623:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787864610.771624:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864610.771625:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864610.771626:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864610.771628:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864610.771629:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864610.771630:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787864610.771631:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864610.771633:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864610.771638:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864610.771640:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787864610.771644:0:6488:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787864610.771646:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787864610.771647:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787864610.771648:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864610.771649:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864610.771649:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864610.771650:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864610.771651:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864610.771652:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787864610.771653:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864610.771654:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864610.771654:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864610.771655:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787864610.771675:0:6488:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787864610.771688:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b41519f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844752128:0@lo:253: 00000100:00100000:1.0:1787864610.771727:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864610.771756:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038b54c65 going to sleep for 11 seconds 00000100:00100000:2.0:1787864610.771846:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752128 00000100:00100000:2.0:1787864610.771851:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752128 00000100:00100000:2.0:1787864610.771910:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787864610.771916:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e4f9f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844752128:12345-0@lo:253: 20000000:01000000:2.0:1787864610.771939:0:6503:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787864610.771950:0:6503:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787864610.779214:0:6503:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787864610.779376:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787864610.779694:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e4f9f1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6488:x1874711844752128:12345-0@lo:253: Request processed in 7774us (7963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.779706:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864610.780024:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b41519f pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6488:1874711844752128:0@lo:253: 10000000:01000000:3.0:1787864610.780037:0:6488:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787864610.780041:0:6488:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864610.780042:0:6488:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787864610.780044:0:6488:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864610.780045:0:6488:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864610.780046:0:6488:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864610.780047:0:6488:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864610.780048:0:6488:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864610.780050:0:6488:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787864610.780051:0:6488:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864610.780053:0:6488:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864610.780054:0:6488:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864610.780055:0:6488:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787864610.780066:0:6488:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787864610.783352:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787864610.783365:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787864610.783812:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.783830:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.783837:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.783885:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.783916:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 11 pid: 6505 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864610.783942:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844752256:0@lo:104: 00000100:00100000:0.0:1787864610.784003:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864610.784057:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d0297349 going to sleep for 11 seconds 00000100:00100000:1.0:1787864610.784192:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752256 00000100:00100000:1.0:1787864610.784199:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752256 00000100:00100000:1.0:1787864610.784247:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864610.784255:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f60eaad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844752256:12345-0@lo:104: 00010000:00010000:1.0:1787864610.784266:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864610.784316:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864610.784321:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f60eaad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844752256:12345-0@lo:104: Request processed in 67us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864610.784328:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1787864610.784389:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00000100:00100000:0.0:1787864610.784467:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844752256:0@lo:104: 00010000:00010000:0.0:1787864610.784499:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787864610.784561:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787864610.784765:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1787864610.785407:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787864610.785601:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1787864610.785775:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1787864610.786213:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864610.786220:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.786230:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000690c3fd8 already unused, calling callback (00000000f9976640) 10000000:00010000:2.0:1787864610.786234:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.786241:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864610.786248:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864610.786337:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864610.786376:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.786383:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864610.788857:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.788874:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 00000000690c3fd8/0x2fcb8c294dc42e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e4b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.789043:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864610.789046:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864610.789048:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864610.789428:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844752384:0@lo:103: 00000100:00100000:1.0:1787864610.789508:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864610.789806:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752384 00000100:00100000:2.0:1787864610.789813:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752384 00010000:00010000:2.0:1787864610.789840:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 12 pid: 6505 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864610.789885:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864610.789919:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f9d62c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3638:x1874711844752384:12345-0@lo:103: 00010000:00010000:2.0:1787864610.789932:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864610.789936:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 12 pid: 6505 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.789948:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 12 pid: 6505 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.789964:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eca4e19c/0x2fcb8c294dc42e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42e44 expref: 12 pid: 6505 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.789985:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.789993:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864610.790008:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006644407s 00010000:00010000:2.0:1787864610.790012:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790017:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790022:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790027:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790032:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a9add8e1 already unused, calling callback (000000001adf2aa7) 00010000:00010000:2.0:1787864610.790035:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790041:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790056:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864610.790065:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864610.790107:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f9d62c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:3638:x1874711844752384:12345-0@lo:103: Request processed in 190us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864610.790114:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864610.790148:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844752384:0@lo:103: 00010000:00010000:0.0:1787864610.790387:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.790396:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864610.790401:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42e7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1787864610.791331:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1787864610.791586:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1787864610.792141:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787864610.792408:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787864610.792707:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787864610.793086:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1787864610.799130:0:6488:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787864610.809798:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787864610.809974:0:6542:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787864610.809979:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787864610.810453:0:6543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787864610.812841:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787864610.812998:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787864610.813690:0:6488:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787864610.813701:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787864610.813837:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864610.815148:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787864610.816027:0:6488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787864610.816069:0:6488:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787864610.818580:0:6543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864610.819001:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787864610.819203:0:6488:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1787864610.820105:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787864610.820221:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787864610.820639:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787864610.820747:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787864610.820871:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787864610.821118:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787864610.821234:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787864610.821462:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787864610.821642:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787864610.821756:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787864610.822376:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787864610.830830:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787864610.831043:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787864610.831214:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000040:00080000:3.0:1787864610.831566:0:6543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787864610.831634:0:6543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787864610.831638:0:6543:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1787864610.831938:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787864610.832106:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787864610.832694:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787864610.832862:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787864610.833029:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787864610.833157:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787864610.833592:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787864610.833771:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787864610.834098:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787864610.834396:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787864610.834868:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787864610.835181:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787864610.835778:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787864610.836092:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787864610.836228:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787864610.836619:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787864610.836754:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787864610.837092:0:6488:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787864610.837448:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787864610.840497:0:6488:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787864610.840635:0:6488:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa20881c6f988 00100000:10000000:1.0:1787864610.840645:0:6488:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787864610.841655:0:6488:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787864610.841670:0:6488:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787864610.841687:0:6488:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787864610.841702:0:6488:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787864610.842605:0:6488:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864610.842756:0:6488:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1787864611.164290:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864612.185926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864613.219223:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864614.236516:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864615.257265:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864615.513821:0:6788:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787864616.217378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787864616.217389:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787864616.217392:0:8:0:(import.c:65:import_set_state_nolock()) 0000000053779d11 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864616.217406:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000053779d11 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864616.217427:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c7e19562 x1874711844752640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864616.217676:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864616.217692:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844752512:0@lo:400: 00000100:00100000:1.0:1787864616.217924:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7e19562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844752640:0@lo:38: 00000100:00100000:1.0:1787864616.224354:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864616.224990:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752640 00000100:00100000:2.0:1787864616.224999:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752640 00000100:00100000:2.0:1787864616.225041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864616.225047:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000303c99c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844752640:12345-0@lo:38: 00010000:00080000:2.0:1787864616.225075:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:2.0:1787864616.225114:0:6512:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2fcb8c294dc42e83 00000004:00100000:2.0:1787864616.225156:0:6512:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787864616.225253:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000ca0ec6e9 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864616.225322:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000303c99c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874711844752640:12345-0@lo:38: Request processed in 274us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864616.225329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864616.226281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864616.226428:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752512 00000100:00100000:1.0:1787864616.226435:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752512 00000100:00100000:1.0:1787864616.226481:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864616.226488:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee0641a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:3640:x1874711844752512:12345-0@lo:400: 00000100:00100000:1.0:1787864616.226539:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee0641a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:3640:x1874711844752512:12345-0@lo:400: Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864616.226546:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787864616.227949:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7e19562 x1874711844752640/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787864616.227972:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787864616.227980:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787864616.227987:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787864616.227990:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000053779d11 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864616.227997:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7e19562 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844752640:0@lo:38: 00000100:00100000:3.0:1787864616.229231:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008183b4b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844752512:0@lo:400: 00010000:00010000:0.0:1787864616.289152:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787864616.423740:0:6840:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864616.423975:0:6840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864617.305531:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864618.329034:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787864619.055522:0:6941:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864619.056594:0:6941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864619.353027:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864619.807202:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787864619.807209:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927548600000 from 3 10000000:01000000:0.0:1787864619.807213:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787864619.807252:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864619.807264:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864619.807275:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864619.807296:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d656b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844752768:0@lo:101: 00000100:00100000:0.0:1787864619.807354:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864619.814458:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bb27e05 going to sleep for 11 seconds 00000100:00100000:2.0:1787864619.814545:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752768 00000100:00100000:2.0:1787864619.814553:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752768 00000100:00100000:2.0:1787864619.814612:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864619.814628:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac08b48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:6508:x1874711844752768:12345-0@lo:101: 00010000:00010000:2.0:1787864619.814645:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864619.814660:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42e8a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864619.814684:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864619.814694:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864619.814702:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f27333e0, rc 0) 00000100:00100000:2.0:1787864619.814766:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac08b48d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6508:x1874711844752768:12345-0@lo:101: Request processed in 140us (7412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864619.814773:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864619.815262:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d656b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844752768:0@lo:101: 00010000:00010000:0.0:1787864619.815279:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864619.815288:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864619.815344:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096d656b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844752896:0@lo:256: 00000100:00100000:0.0:1787864619.815379:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864619.815410:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bb27e05 going to sleep for 11 seconds 00000100:00100000:2.0:1787864619.818431:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844752896 00000100:00100000:2.0:1787864619.818444:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844752896 00000100:00100000:2.0:1787864619.818494:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864619.818501:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faaf3fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6508:x1874711844752896:12345-0@lo:256: 20000000:01000000:2.0:1787864619.818524:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787864619.818544:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787864619.818547:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787864619.818657:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faaf3fd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:6508:x1874711844752896:12345-0@lo:256: Request processed in 156us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864619.818665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864619.818725:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096d656b6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844752896:0@lo:256: 10000000:01000000:2.0:1787864619.818778:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864619.818785:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864619.818799:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864620.378323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864621.339589:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864621.339626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8640320 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844753024:0@lo:400: 00000100:00100000:2.0:1787864621.339699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864621.339766:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2392dc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844753152:0@lo:400: 00000100:00100000:2.0:1787864621.339799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864621.339843:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753024 00000100:00100000:2.0:1787864621.339850:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753024 00000100:00100000:2.0:1787864621.339916:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787864621.339924:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000420d9ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3639:x1874711844753024:12345-0@lo:400: 00000100:00100000:2.0:1787864621.339973:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000420d9ac9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3639:x1874711844753024:12345-0@lo:400: Request processed in 50us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864621.339981:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787864621.340011:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753152 00000100:00100000:2.0:1787864621.340014:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753152 00000100:00100000:2.0:1787864621.340037:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864621.340043:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001711af2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844753152:12345-0@lo:400: 00000100:00100000:2.0:1787864621.340076:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001711af2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844753152:12345-0@lo:400: Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864621.340081:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787864621.340116:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a2392dc3 x1874711844753152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864621.340129:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2392dc3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844753152:0@lo:400: 00000100:00100000:2.0:1787864621.340173:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8640320 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844753024:0@lo:400: 00010000:00010000:1.0:1787864621.401037:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864622.434351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864623.449504:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864624.476351:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864625.497350:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864626.457412:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000715da09b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844753280:0@lo:400: 00000100:00100000:2.0:1787864626.457519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864626.457624:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753280 00000100:00100000:2.0:1787864626.457633:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753280 00000100:00100000:2.0:1787864626.457691:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864626.457699:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eebfff49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3638:x1874711844753280:12345-0@lo:400: 00000100:00100000:2.0:1787864626.457770:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eebfff49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3638:x1874711844753280:12345-0@lo:400: Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864626.457778:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864626.457839:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000715da09b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844753280:0@lo:400: 00000100:00100000:3.0:1787864626.458474:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844753408:0@lo:400: 00000100:00100000:3.0:1787864626.458531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864626.460280:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753408 00000100:00100000:2.0:1787864626.460297:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753408 00000100:00100000:2.0:1787864626.460405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864626.460415:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085d8b7f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844753408:12345-0@lo:400: 00000100:00100000:2.0:1787864626.460529:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085d8b7f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844753408:12345-0@lo:400: Request processed in 115us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864626.460537:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787864626.461269:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b450436d x1874711844753408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864626.461290:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844753408:0@lo:400: 00010000:00010000:0.0:1787864626.521645:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864627.552202:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864628.569733:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864628.737382:0:7439:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787864628.737388:0:7439:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787864628.737389:0:7439:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787864628.737544:0:7439:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a461f61a 00000020:01000004:2.0:1787864628.737565:0:7439:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1787864628.737577:0:7439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787864628.737600:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000632d5f15) 00000020:00000080:2.0:1787864628.737620:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787864628.812376:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1787864628.812465:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787864628.844714:0:7439:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787864628.845534:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787864628.845558:0:7439:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787864628.845569:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc42e9f 00000020:01000004:0.0:1787864628.845577:0:7439:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787864628.845597:0:7439:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787864628.845600:0:7439:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787864628.845606:0:7439:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787864628.845632:0:7439:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787864628.845637:0:7439:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787864628.876433:0:7439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787864628.876481:0:7439:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.136@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1787864628.876485:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787864628.876486:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787864628.876488:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864628.876489:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864628.876490:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864628.876491:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864628.876492:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864628.876494:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864628.876495:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864628.876496:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864628.876497:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864628.876500:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1787864628.876503:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864628.876504:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787864628.876505:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864628.876506:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864628.876506:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864628.876507:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864628.876508:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864628.876509:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787864628.876510:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787864628.876511:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864628.876512:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787864628.876537:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787864628.876555:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009440b574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844753536:0@lo:253: 00000100:00100000:0.0:1787864628.876625:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864628.876777:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753536 00000100:00100000:2.0:1787864628.876784:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753536 00000100:00100000:2.0:1787864628.876834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864628.876842:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe40f45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844753536:12345-0@lo:253: 20000000:01000000:2.0:1787864628.876872:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787864628.876876:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1787864628.876880:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1787864628.876883:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1787864628.876933:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000100:00100000:0.0:1787864628.877030:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000008aa08b34 going to sleep for 11 seconds 00000040:00080000:2.0:1787864628.880576:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864628.882586:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787864628.882619:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787864628.882661:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1787864628.882678:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1787864628.882706:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1787864628.882867:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1787864628.882877:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1787864628.883321:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1787864628.883333:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1787864628.883351:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1787864628.883369:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1787864628.883386:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787864628.883402:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787864628.883505:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1787864628.883514:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787864628.883526:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1787864628.883531:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787864628.883543:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1787864628.883549:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:3.0:1787864628.883562:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1787864628.883567:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787864628.883581:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787864628.883598:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787864628.883608:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1787864628.883686:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1787864628.883707:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1787864628.883722:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787864628.883738:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787864628.883840:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1787864628.883848:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1787864628.883863:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787864628.883886:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787864628.883960:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1787864628.883983:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787864628.883990:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1787864628.891339:0:7445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1787864628.892616:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787864628.892646:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.136@tcp for mdt 20000000:01000000:2.0:1787864628.892648:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:2.0:1787864628.892683:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787864628.892700:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787864628.892717:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787864628.892723:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:2.0:1787864628.892836:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787864628.892848:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1787864628.892866:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1787864628.892948:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1787864628.893018:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1787864628.893203:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1787864628.893626:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1787864628.893868:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787864628.893884:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.136@tcp for mdt 20000000:01000000:2.0:1787864628.894263:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:2.0:1787864628.894288:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787864628.894296:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787864628.894311:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787864628.894316:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:2.0:1787864628.894329:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787864628.894336:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1787864628.894348:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787864628.894362:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1787864628.894381:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787864628.894384:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787864628.894388:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787864628.894431:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787864628.894434:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787864628.894807:0:7447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787864628.894826:0:7447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787864628.894840:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1787864628.895023:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787864628.895067:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787864628.895089:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1787864628.895112:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787864628.895121:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787864628.895800:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787864628.895823:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787864628.895837:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787864628.896352:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787864628.896379:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787864628.896406:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787864628.896419:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787864628.896421:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787864628.897001:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787864628.897042:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787864628.897066:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787864628.897465:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1787864628.897488:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1787864628.897503:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1787864628.897518:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787864628.897521:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787864628.897525:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787864628.897531:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787864628.898389:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1787864628.898517:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787864628.911080:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864628.912441:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912465:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912473:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912480:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912485:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912527:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912540:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.912567:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753664:0@lo:104: 00000100:00100000:3.0:1787864628.912632:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864628.912714:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912722:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 12 pid: 6505 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.912730:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753792:0@lo:104: 00000100:00100000:3.0:1787864628.912762:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864628.912786:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.912793:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 12 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.912800:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753920:0@lo:104: 00000100:00100000:3.0:1787864628.912819:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864628.912829:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4b701ed going to sleep for 11 seconds 00000100:00100000:1.0:1787864628.913005:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753664 00000100:00100000:1.0:1787864628.913013:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753664 00000100:00100000:1.0:1787864628.913068:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753792 00000100:00100000:1.0:1787864628.913072:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753792 00000100:00100000:1.0:1787864628.913083:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844753920 00000100:00100000:1.0:1787864628.913085:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844753920 00000100:00100000:1.0:1787864628.913107:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864628.913114:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000715da09b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6505:x1874711844753664:12345-0@lo:104: 00010000:00010000:1.0:1787864628.913125:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913177:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864628.913181:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000715da09b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6505:x1874711844753664:12345-0@lo:104: Request processed in 70us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.913196:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864628.913212:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864628.913217:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3460c8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6505:x1874711844753792:12345-0@lo:104: 00010000:00010000:1.0:1787864628.913223:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913258:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864628.913262:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3460c8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6505:x1874711844753792:12345-0@lo:104: Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.913268:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864628.913279:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864628.913284:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e4c0404 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6505:x1874711844753920:12345-0@lo:104: 00010000:00010000:1.0:1787864628.913289:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913312:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787864628.913316:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e4c0404 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6505:x1874711844753920:12345-0@lo:104: Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.913321:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787864628.913336:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787864628.913341:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913348:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9f4fcb9 already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864628.913351:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913370:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864628.913375:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864628.913380:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864628.913408:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913414:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864628.913429:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913435:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 00000000b9f4fcb9/0x2fcb8c294dc42e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e67 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913445:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864628.913448:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913452:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083db9336 already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864628.913454:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913459:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864628.913463:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864628.913474:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864628.913485:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913492:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864628.913504:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913510:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 0000000083db9336/0x2fcb8c294dc42df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42df7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913518:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864628.913520:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913524:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a9fb8be already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864628.913526:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913531:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864628.913535:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864628.913539:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864628.913550:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913555:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864628.913566:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913571:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ddb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913584:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864628.913586:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864628.913587:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864628.913606:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7a9b9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844754048:0@lo:103: 00000100:00100000:1.0:1787864628.913635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.913674:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d798a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844754176:0@lo:103: 00000100:00100000:1.0:1787864628.913711:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.913729:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864628.913734:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844754304:0@lo:103: 00000100:00100000:1.0:1787864628.913766:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.913799:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754048 00000100:00100000:1.0:1787864628.913803:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754048 00010000:00010000:1.0:1787864628.913821:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 13 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864628.913833:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754176 00000100:00100000:1.0:1787864628.913836:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754176 00010000:00010000:1.0:1787864628.913843:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 14 pid: 6505 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864628.913851:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754304 00000100:00100000:1.0:1787864628.913853:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754304 00010000:00010000:1.0:1787864628.913871:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 15 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864628.913919:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864628.913925:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f880b71a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3640:x1874711844754048:12345-0@lo:103: 00010000:00010000:1.0:1787864628.913934:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864628.913938:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 15 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913947:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 15 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.913961:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864628.913988:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f880b71a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3640:x1874711844754048:12345-0@lo:103: Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.913994:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864628.914006:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864628.914011:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b0f9a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3637:x1874711844754176:12345-0@lo:103: 00010000:00010000:1.0:1787864628.914018:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864628.914021:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 14 pid: 6505 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914029:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 14 pid: 6505 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914038:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864628.914061:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b0f9a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3637:x1874711844754176:12345-0@lo:103: Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.914067:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864628.914077:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864628.914088:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023cfbc2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:3637:x1874711844754304:12345-0@lo:103: 00010000:00010000:1.0:1787864628.914096:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864628.914099:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 13 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914107:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 13 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914117:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914123:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914135:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914142:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914146:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914152:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914157:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b62d4ea7 already unused, calling callback (000000001adf2aa7) 00010000:00010000:1.0:1787864628.914160:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914166:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914179:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.914187:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864628.914209:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023cfbc2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:3637:x1874711844754304:12345-0@lo:103: Request processed in 121us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.914214:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864628.914250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7a9b9eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844754048:0@lo:103: 00000100:00100000:1.0:1787864628.914273:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844754304:0@lo:103: 00000100:00100000:1.0:1787864628.914279:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d798a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844754176:0@lo:103: 00010000:00010000:2.0:1787864628.914699:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864628.914780:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000ef53c24/0x2fcb8c294dc42e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42e60 expref: 12 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.914793:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753664:0@lo:104: 00010000:00010000:3.0:1787864628.914804:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000247f88d6/0x2fcb8c294dc42df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42df0 expref: 11 pid: 6505 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.914813:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753792:0@lo:104: 00010000:00010000:3.0:1787864628.914821:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000069fc14a5/0x2fcb8c294dc42ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42dd4 expref: 10 pid: 6504 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864628.914838:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1874711844753920:0@lo:104: 00010000:00010000:3.0:1787864628.914868:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.914877:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.914882:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.914908:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42ea6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787864628.914923:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787864628.917802:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe40f45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:7439:x1874711844753536:12345-0@lo:253: Request processed in 40954us (41171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864628.917817:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864628.918066:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009440b574 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844753536:0@lo:253: 10000000:01000000:2.0:1787864628.918081:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787864628.918084:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787864628.918086:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787864628.918087:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864628.918089:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787864628.918090:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864628.918099:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864628.918100:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787864628.918102:0:7439:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787864628.918104:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864628.918105:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787864628.918123:0:7439:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a461f61a from lustre-MDT0001 10000000:01000000:2.0:1787864628.918158:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787864628.918161:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787864628.918167:0:7439:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92755ed9ced8 local copy 10000000:01000000:2.0:1787864628.918171:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787864628.918201:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864628.918211:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864628.918219:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864628.918237:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058fcda6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754432:0@lo:101: 00000100:00100000:2.0:1787864628.918271:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864628.918822:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d4a56c3 going to sleep for 11 seconds 00000100:00100000:3.0:1787864628.919624:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754432 00000100:00100000:3.0:1787864628.919632:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754432 00000100:00100000:3.0:1787864628.919686:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864628.919703:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5296d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+9:7439:x1874711844754432:12345-0@lo:101: 00010000:00010000:3.0:1787864628.919718:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864628.919733:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce96ae6e/0x2fcb8c294dc42eb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42ead expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.919766:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce96ae6e/0x2fcb8c294dc42eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ead expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.919775:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce96ae6e/0x2fcb8c294dc42eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ead expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.919795:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce96ae6e, rc 0) 00000100:00100000:3.0:1787864628.920099:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5296d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:7439:x1874711844754432:12345-0@lo:101: Request processed in 389us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864628.921549:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864628.925213:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058fcda6c pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754432:0@lo:101: 00010000:00010000:0.0:1787864628.925244:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.925256:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864628.925394:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754560:0@lo:501: 00000100:00100000:0.0:1787864628.925473:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864628.925517:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d103cad going to sleep for 11 seconds 00000100:00100000:2.0:1787864628.925834:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754560 00000100:00100000:2.0:1787864628.925847:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754560 00000100:00100000:2.0:1787864628.925958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864628.925967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000921e72b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:7439:x1874711844754560:12345-0@lo:501: 00000100:00100000:2.0:1787864628.926056:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000921e72b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:7439:x1874711844754560:12345-0@lo:501: Request processed in 90us (584us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864628.926064:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864628.926146:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754560:0@lo:501: 10000000:01000000:0.0:1787864628.926164:0:7439:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787864628.926181:0:7439:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787864628.926185:0:7439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.926193:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.926198:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.926214:0:7439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787864628.926236:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff927547df8000 10000000:01000000:0.0:1787864628.926241:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787864628.926245:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92755ed9ced8 10000000:01000000:0.0:1787864628.926248:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787864628.926257:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92755ed9ced8 from 1 10000000:01000000:0.0:1787864628.926260:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787864628.926283:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.926289:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.926297:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864628.926309:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754688:0@lo:101: 00000100:00100000:0.0:1787864628.926336:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864628.932980:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031861bc1 going to sleep for 11 seconds 00000100:00100000:3.0:1787864628.933735:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754688 00000100:00100000:3.0:1787864628.933745:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754688 00000100:00100000:3.0:1787864628.933789:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787864628.933797:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c929853f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+10:7439:x1874711844754688:12345-0@lo:101: 00010000:00010000:3.0:1787864628.933812:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864628.933827:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864628.933829:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000842006df/0x2fcb8c294dc42ec2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42ebb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.933833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.933840:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035137995 already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864628.933843:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.933850:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.933852:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000842006df/0x2fcb8c294dc42ec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ebb expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.933862:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000842006df/0x2fcb8c294dc42ec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ebb expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864628.933870:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000842006df, rc 0) 00000100:00100000:3.0:1787864628.933967:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c929853f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:7439:x1874711844754688:12345-0@lo:101: Request processed in 171us (7631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864628.933974:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864628.933984:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754688:0@lo:101: 00010000:00010000:0.0:1787864628.933998:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.934006:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864628.934046:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787864628.934057:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.934064:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 0000000045704f88/0x2fcb8c294dc42ebb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864628.934074:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff927547df8000 10000000:01000000:0.0:1787864628.934078:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787864628.934094:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff927547df8000 from 1 10000000:01000000:0.0:1787864628.934096:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787864628.934120:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.934126:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.934133:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864628.934149:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754816:0@lo:101: 00000100:00100000:0.0:1787864628.934183:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864628.934205:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031861bc1 going to sleep for 11 seconds 10000000:00010000:1.0:1787864628.934299:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864628.934306:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864628.934326:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934343:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864628.934369:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934376:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 0000000035137995/0x2fcb8c294dc42ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc42eb4 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934391:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864628.934392:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864628.934394:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864628.934407:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864628.934418:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000032d798a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844754944:0@lo:103: 00000100:00100000:1.0:1787864628.934446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.934471:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754816 00000100:00100000:1.0:1787864628.934475:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754816 00000100:00100000:1.0:1787864628.934501:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864628.934509:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d867ff4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:7439:x1874711844754816:12345-0@lo:101: 00010000:00010000:1.0:1787864628.934517:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864628.934524:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc297557/0x2fcb8c294dc42ed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42ec9 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934539:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc297557/0x2fcb8c294dc42ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ec9 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934547:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc297557/0x2fcb8c294dc42ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ec9 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.934553:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc297557, rc 0) 00000100:00100000:1.0:1787864628.934587:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d867ff4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844754816:12345-0@lo:101: Request processed in 80us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.934593:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864628.934730:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844754816:0@lo:101: 00010000:00010000:0.0:1787864628.934808:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.934817:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864628.934831:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:1.0:1787864628.934863:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844754944 00000100:00100000:1.0:1787864628.934867:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844754944 00010000:00010000:0.0:1787864628.935085:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.935094:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000e9bc9af8/0x2fcb8c294dc42ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864628.935101:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787864628.935105:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864628.935116:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff927547df8000 10000000:01000000:0.0:1787864628.935118:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787864628.935121:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787864628.935123:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787864628.935139:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.935145:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864628.935152:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864628.935164:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755072:0@lo:101: 00000100:00100000:0.0:1787864628.935196:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864628.935257:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 0000000031861bc1 going to sleep for 11 seconds 00000100:00100000:1.0:1787864628.935314:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864628.935323:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b21b1c45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3640:x1874711844754944:12345-0@lo:103: 00010000:00010000:1.0:1787864628.935333:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864628.935345:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce96ae6e/0x2fcb8c294dc42eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc42ead expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.935357:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864628.935393:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b21b1c45 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:3640:x1874711844754944:12345-0@lo:103: Request processed in 73us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864628.935400:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864628.935457:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000032d798a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844754944:0@lo:103: 00000100:00100000:2.0:1787864628.935494:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755072 00000100:00100000:2.0:1787864628.935499:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755072 00000100:00100000:2.0:1787864628.935560:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864628.935567:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ad8f917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+11:7439:x1874711844755072:12345-0@lo:101: 00010000:00010000:2.0:1787864628.935574:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864628.935583:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000690c3fd8/0x2fcb8c294dc42ede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42ed7 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864628.935595:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000690c3fd8/0x2fcb8c294dc42ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864628.935603:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000690c3fd8/0x2fcb8c294dc42ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864628.935609:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000690c3fd8, rc 0) 00000100:00100000:2.0:1787864628.935723:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ad8f917 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755072:12345-0@lo:101: Request processed in 156us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864628.935729:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864628.936051:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755072:0@lo:101: 00010000:00010000:1.0:1787864628.936063:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864628.936070:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864628.936178:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7a9b9eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755200:0@lo:501: 00000100:00100000:1.0:1787864628.936208:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.936229:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3db337c going to sleep for 11 seconds 00000100:00100000:2.0:1787864628.936406:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755200 00000100:00100000:2.0:1787864628.936411:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755200 00000100:00100000:2.0:1787864628.936443:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787864628.936449:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029cbcc2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755200:12345-0@lo:501: 00000100:00100000:2.0:1787864628.936550:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029cbcc2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755200:12345-0@lo:501: Request processed in 101us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864628.936564:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864628.936588:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7a9b9eb pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755200:0@lo:501: 00000100:00100000:3.0:1787864628.936616:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755328:0@lo:503: 00000100:00100000:3.0:1787864628.936653:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864628.936679:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c31a67a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787864628.936738:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755328 00000100:00100000:2.0:1787864628.936753:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755328 00000100:00100000:2.0:1787864628.936771:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787864628.936777:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac2e9be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755328:12345-0@lo:503: 00000100:00100000:2.0:1787864628.936869:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac2e9be2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755328:12345-0@lo:503: Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864628.936876:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787864628.936910:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755328:0@lo:503: 00000040:00080000:3.0:1787864628.937606:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864628.937666:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755456:0@lo:502: 00000100:00100000:3.0:1787864628.937719:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864628.937755:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c31a67a4 going to sleep for 11 seconds 00000100:00100000:2.0:1787864628.937807:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755456 00000100:00100000:2.0:1787864628.937816:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755456 00000100:00100000:2.0:1787864628.937851:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864628.937859:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da8e0dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755456:12345-0@lo:502: 00000100:00100000:2.0:1787864628.938002:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da8e0dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755456:12345-0@lo:502: Request processed in 144us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864628.938009:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864628.938033:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006bdfc32e pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755456:0@lo:502: 00000040:00080000:1.0:1787864628.938226:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787864628.938252:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1787864628.938277:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1787864628.938291:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1787864628.938303:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1787864628.938315:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1787864628.938327:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1787864628.938341:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1787864628.938367:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1787864628.938381:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1787864628.938393:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1787864628.938404:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1787864628.938417:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1787864628.938431:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1787864628.938444:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1787864628.938455:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1787864628.938467:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1787864628.938479:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1787864628.938490:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1787864628.938501:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1787864628.938513:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1787864628.938525:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1787864628.938538:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1787864628.938563:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c1a903a pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755584:0@lo:502: 00000100:00100000:1.0:1787864628.938604:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864628.938979:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae97de3a going to sleep for 11 seconds 00000100:00100000:0.0:1787864628.939106:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755584 00000100:00100000:0.0:1787864628.939113:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755584 00000100:00100000:0.0:1787864628.939153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864628.939160:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000574643b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755584:12345-0@lo:502: 00000100:00100000:0.0:1787864628.939268:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000574643b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:7439:x1874711844755584:12345-0@lo:502: Request processed in 107us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864628.939275:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864628.941393:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c1a903a pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844755584:0@lo:502: 00000040:00080000:2.0:1787864628.941500:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1787864628.941513:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1787864628.942304:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864628.942727:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864628.942730:0:7451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787864628.942736:0:7451:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787864628.942741:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864628.942755:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000009e2696d7) 00000020:00000080:2.0:1787864628.942775:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1787864628.942781:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787864628.942871:0:7451:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787864628.942884:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc42eec 00000020:00000080:2.0:1787864628.943164:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787864628.943168:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864628.943172:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864628.943174:0:7451:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787864628.943176:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864628.943180:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864628.943181:0:7451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787864628.943184:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864628.943191:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000007f27ce0) 00000020:00000080:2.0:1787864628.943201:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1787864628.943205:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787864628.943207:0:7451:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787864628.943209:0:7451:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787864628.943216:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787864628.943279:0:7451:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a461f61a from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787864628.943301:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d438439d) 00000020:00000080:2.0:1787864628.943311:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1787864628.943384:0:7451:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787864628.943390:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc42f01 00000020:00000080:2.0:1787864628.943489:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787864628.943496:0:7451:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787864628.943501:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2fcb8c294dc42f08 00080000:01000000:2.0:1787864628.943506:0:7451:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787864628.943509:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc42f0f 00080000:10000000:2.0:1787864628.943923:0:7451:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787864628.944051:0:7451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1787864629.035475:0:7451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1787864629.035722:0:7451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1787864629.040400:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787864629.040764:0:7451:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787864629.053282:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787864629.053295:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864629.053301:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.053303:0:7451:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787864629.053307:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864629.053312:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.053314:0:7451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787864629.053318:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787864629.053323:0:7451:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:00000080:3.0:1787864629.053350:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864629.053364:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000de770331) 00000020:00000080:3.0:1787864629.053385:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787864629.053391:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787864629.053466:0:7451:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787864629.053473:0:7451:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787864629.053480:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc42f1d 00010000:00080000:3.0:1787864629.053512:0:7451:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000056c97327@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864629.060454:0:7451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1787864629.061704:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787864629.061718:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787864629.061764:0:7451:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787864629.061784:0:7451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc42f24 00000100:00080000:3.0:1787864629.061795:0:7451:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864629.061801:0:7451:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000056c97327 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864629.061833:0:7451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007fcc895d x1874711844755712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864629.061871:0:7451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787864629.061994:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864629.061998:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062000:0:7451:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787864629.062003:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787864629.062005:0:7451:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787864629.062007:0:7451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787864629.062008:0:7451:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787864629.062010:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787864629.062012:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062013:0:7451:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787864629.062015:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864629.062020:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062021:0:7451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787864629.062024:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787864629.062053:0:7451:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787864629.062066:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864629.062069:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062070:0:7451:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787864629.062073:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864629.062076:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062077:0:7451:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864629.062079:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864629.062080:0:7451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787864629.062105:0:7451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864629.062108:0:7451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864629.062109:0:7451:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864629.062112:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1787864629.062261:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844755712:0@lo:38: 00000100:00100000:0.0:1787864629.062336:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.062820:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755712 00000100:00100000:3.0:1787864629.062828:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755712 00000100:00100000:3.0:1787864629.062874:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864629.062880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eae9d9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844755712:12345-0@lo:38: 00010000:00080000:3.0:1787864629.062932:0:6515:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1787864629.062962:0:6515:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc42f2b 00000004:00100000:3.0:1787864629.062976:0:6515:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787864629.062981:0:6515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787864629.063274:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffb564f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844755840:0@lo:400: 00000100:00100000:0.0:1787864629.063329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864629.063401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755840 00000100:00100000:2.0:1787864629.063406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755840 00000100:00100000:2.0:1787864629.063444:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864629.063450:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002315c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+12:3640:x1874711844755840:12345-0@lo:400: 00000020:01000000:1.0:1787864629.063544:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1787864629.063578:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787864629.063589:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.063600:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000daf47e0d/0x2fcb8c294dc42ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864629.063631:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927547df8000 from 1 10000000:01000000:1.0:1787864629.063634:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787864629.063654:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.063661:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.063669:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.063682:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756096:0@lo:101: 00000100:00100000:1.0:1787864629.063722:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.063738:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aea2c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787864629.063769:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc328296 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844755968:0@lo:400: 00000100:00100000:1.0:1787864629.063795:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.063834:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756096 00000100:00100000:1.0:1787864629.063838:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756096 00000100:00100000:1.0:1787864629.064144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864629.064154:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a277840b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:7439:x1874711844756096:12345-0@lo:101: 00010000:00010000:1.0:1787864629.064163:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864629.064174:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f32 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.064194:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.064204:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.064217:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083db9336, rc 0) 00000100:00100000:1.0:1787864629.064247:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a277840b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756096:12345-0@lo:101: Request processed in 95us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864629.064299:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002315c3e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3640:x1874711844755840:12345-0@lo:400: Request processed in 850us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.064356:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864629.064389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844755968 00000100:00100000:1.0:1787864629.064393:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844755968 00000100:00100000:1.0:1787864629.064426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864629.064431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b41519f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844755968:12345-0@lo:400: 00000100:00100000:1.0:1787864629.064465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b41519f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844755968:12345-0@lo:400: Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.064470:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787864629.064498:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cc328296 x1874711844755968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864629.064510:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc328296 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844755968:0@lo:400: 00000100:00100000:1.0:1787864629.064538:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756096:0@lo:101: 00010000:00010000:1.0:1787864629.064549:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.064557:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.065362:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756224:0@lo:256: 00000100:00100000:1.0:1787864629.065405:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.065438:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aea2c73c going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.065483:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756224 00000100:00100000:3.0:1787864629.065489:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756224 00000100:00100000:3.0:1787864629.065527:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864629.065534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ffd1efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756224:12345-0@lo:256: 20000000:01000000:3.0:1787864629.065548:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787864629.065565:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787864629.065568:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787864629.065663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ffd1efd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756224:12345-0@lo:256: Request processed in 130us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.065670:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864629.067441:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756224:0@lo:256: 10000000:01000000:1.0:1787864629.068260:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787864629.068282:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068293:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864629.068302:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927547df8000 from 1 10000000:01000000:1.0:1787864629.068305:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864629.068335:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068343:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068352:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.068370:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756352:0@lo:101: 00000100:00100000:1.0:1787864629.068423:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.068449:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aea2c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787864629.068476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756352 00000100:00100000:1.0:1787864629.068482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756352 00000100:00100000:1.0:1787864629.068521:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864629.068529:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004639cf4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756352:12345-0@lo:101: 00010000:00010000:1.0:1787864629.068541:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864629.068553:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f40 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068574:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068593:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.068601:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe189d20, rc 0) 00000100:00080000:3.0:1787864629.069007:0:6515:0:(import.c:65:import_set_state_nolock()) 0000000084f64f44 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864629.069068:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eae9d9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844755712:12345-0@lo:38: Request processed in 6187us (6732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.069077:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864629.069261:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffb564f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844755840:0@lo:400: 00000100:00100000:0.0:1787864629.069296:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864629.069303:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787864629.069310:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787864629.069315:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787864629.069317:0:3636:0:(import.c:65:import_set_state_nolock()) 0000000056c97327 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864629.069336:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844755712:0@lo:38: 00000100:00100000:2.0:1787864629.069407:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787864629.069582:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844756480:0@lo:41: 00000100:00100000:0.0:1787864629.069699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.070061:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756480 00000100:00100000:3.0:1787864629.070067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756480 00000100:00100000:3.0:1787864629.070096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864629.070103:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000070f7e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844756480:12345-0@lo:41: 00000004:00000024:3.0:1787864629.070125:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1787864629.070258:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004639cf4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756352:12345-0@lo:101: Request processed in 1730us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.070265:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864629.070305:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756352:0@lo:101: 00010000:00010000:1.0:1787864629.070320:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.070331:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.070421:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756608:0@lo:501: 00000100:00100000:1.0:1787864629.070447:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.070468:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aea2c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787864629.070483:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756608 00000100:00100000:1.0:1787864629.070486:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756608 00000100:00100000:1.0:1787864629.070510:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787864629.070516:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ff4c2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756608:12345-0@lo:501: 00000100:00100000:1.0:1787864629.070596:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ff4c2f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756608:12345-0@lo:501: Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.070603:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787864629.070644:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756608:0@lo:501: 00000100:00100000:1.0:1787864629.070670:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756736:0@lo:503: 00000100:00100000:1.0:1787864629.070727:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.070860:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aea2c73c going to sleep for 11 seconds 00000100:00100000:1.0:1787864629.070872:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756736 00000100:00100000:1.0:1787864629.070876:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756736 00000100:00100000:1.0:1787864629.070958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787864629.070965:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c32f3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756736:12345-0@lo:503: 00000040:00080000:1.0:1787864629.070995:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864629.071031:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c32f3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756736:12345-0@lo:503: Request processed in 67us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.071037:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864629.071180:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000070f7e8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844756480:12345-0@lo:41: Request processed in 1077us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.071188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864629.071397:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b450436d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844756480:0@lo:41: 00000100:00100000:1.0:1787864629.071454:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756736:0@lo:503: 00000040:00080000:1.0:1787864629.071849:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864629.072093:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1787864629.072168:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864629.073258:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1787864629.073438:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787864629.073462:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864629.073513:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.073525:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864629.073573:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787864629.073576:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff927547df8000 10000000:01000000:1.0:1787864629.073579:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff927547df8000 10000000:01000000:1.0:1787864629.073583:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787864629.073589:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927547df8000 from 1 10000000:01000000:1.0:1787864629.073592:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787864629.073728:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.073837:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.073848:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.074286:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756864:0@lo:101: 00000100:00100000:1.0:1787864629.074340:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.074445:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae97de3a going to sleep for 11 seconds 00000100:00100000:2.0:1787864629.074520:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756864 00000100:00100000:2.0:1787864629.074526:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756864 00000100:00100000:2.0:1787864629.074593:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787864629.074600:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033007576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:7439:x1874711844756864:12345-0@lo:101: 00010000:00010000:2.0:1787864629.074620:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864629.074632:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035137995/0x2fcb8c294dc42f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f4e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864629.074651:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035137995/0x2fcb8c294dc42f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864629.074660:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035137995/0x2fcb8c294dc42f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864629.074668:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035137995, rc 0) 00000100:00100000:2.0:1787864629.074715:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033007576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844756864:12345-0@lo:101: Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864629.074721:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864629.074782:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756864:0@lo:101: 00010000:00010000:1.0:1787864629.074794:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.074802:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.074884:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756992:0@lo:501: 00000100:00100000:1.0:1787864629.074933:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.075259:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae97de3a going to sleep for 11 seconds 00000100:00100000:0.0:1787864629.075284:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844756992 00000100:00100000:0.0:1787864629.075288:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844756992 00000100:00100000:2.0:1787864629.075319:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787864629.075325:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030500855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844756992:12345-0@lo:501: 00000100:00100000:2.0:1787864629.075412:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030500855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844756992:12345-0@lo:501: Request processed in 88us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864629.075419:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787864629.075464:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844756992:0@lo:501: 00000100:00100000:1.0:1787864629.075488:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757120:0@lo:503: 00000100:00100000:1.0:1787864629.075524:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.075593:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae97de3a going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.075681:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757120 00000100:00100000:3.0:1787864629.075699:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757120 00000100:00100000:3.0:1787864629.075719:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787864629.075723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d8df119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757120:12345-0@lo:503: 00000100:00100000:3.0:1787864629.075840:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d8df119 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757120:12345-0@lo:503: Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.075847:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787864629.076021:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757120:0@lo:503: 00000040:00080000:1.0:1787864629.076235:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864629.076299:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757248:0@lo:502: 00000100:00100000:1.0:1787864629.076330:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.076358:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ca08ab1 going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.076395:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757248 00000100:00100000:3.0:1787864629.076398:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757248 00000100:00100000:3.0:1787864629.076414:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787864629.076419:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f225fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757248:12345-0@lo:502: 00000100:00100000:3.0:1787864629.076486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f225fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757248:12345-0@lo:502: Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.076492:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787864629.076546:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757248:0@lo:502: 00000040:00080000:1.0:1787864629.076682:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787864629.076715:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787864629.076727:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787864629.076738:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787864629.076965:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787864629.076979:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787864629.076990:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787864629.077001:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787864629.077011:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787864629.077022:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787864629.077032:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787864629.077043:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787864629.077053:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787864629.077075:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787864629.077087:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787864629.077097:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787864629.077107:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787864629.077118:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787864629.077128:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787864629.077139:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787864629.077150:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787864629.077162:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787864629.077172:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787864629.077183:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787864629.077195:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787864629.077206:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787864629.077218:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787864629.077241:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1787864629.077264:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757376:0@lo:502: 00000100:00100000:1.0:1787864629.077306:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.077335:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ae97de3a going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.077383:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757376 00000100:00100000:3.0:1787864629.077388:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757376 00000100:00100000:3.0:1787864629.077409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787864629.077414:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014ef7c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757376:12345-0@lo:502: 00000100:00100000:3.0:1787864629.077497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014ef7c01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757376:12345-0@lo:502: Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.077504:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864629.077573:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757376:0@lo:502: 00000040:00080000:1.0:1787864629.077698:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787864629.077707:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787864629.078446:0:7457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787864629.078461:0:7457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000003248a71e) 00000020:00000080:3.0:1787864629.078479:0:7457:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787864629.078570:0:7457:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a461f61a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787864629.078575:0:7457:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a461f61a from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787864629.078577:0:7457:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a461f61a 3 00010000:00080000:3.0:1787864629.078704:0:7457:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006261b070@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864629.082158:0:7457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1787864629.082393:0:7457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787864629.082431:0:7457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787864629.082443:0:7457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2fcb8c294dc42f63 00000100:00080000:3.0:1787864629.082452:0:7457:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864629.082457:0:7457:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000006261b070 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864629.082489:0:7457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d0b87006 x1874711844757504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864629.082523:0:7457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787864629.082767:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844757504:0@lo:38: 00000100:00100000:0.0:1787864629.082832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.083079:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757504 00000100:00100000:3.0:1787864629.083086:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757504 00000100:00100000:3.0:1787864629.083116:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864629.083123:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7284a51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844757504:12345-0@lo:38: 00010000:00080000:3.0:1787864629.083144:0:6511:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1787864629.083172:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2fcb8c294dc42f6a 00000004:00100000:3.0:1787864629.083185:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787864629.083208:0:6511:0:(import.c:65:import_set_state_nolock()) 000000002526e30a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864629.083270:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7284a51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874711844757504:12345-0@lo:38: Request processed in 146us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.083277:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787864629.083444:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d0b87006 x1874711844757504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864639 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864629.083454:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864629.083461:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787864629.083468:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787864629.083471:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787864629.083474:0:3636:0:(import.c:65:import_set_state_nolock()) 000000006261b070 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864629.083479:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844757504:0@lo:38: 00000040:00080000:3.0:1787864629.083702:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:2.0:1787864629.084056:0:7458:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:1.0:1787864629.086466:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787864629.086507:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787864629.086531:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.086543:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000159f6c5a/0x2fcb8c294dc42f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787864629.086590:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787864629.086593:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787864629.086594:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864629.086595:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864629.086597:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864629.086598:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864629.086599:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864629.086601:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864629.086602:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864629.086603:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864629.086604:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787864629.086608:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787864629.086610:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787864629.086686:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787864629.086687:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864629.086696:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864629.086697:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864629.086698:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864629.086699:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864629.086707:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864629.086708:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864629.086708:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864629.086709:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787864629.086734:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787864629.086868:0:7439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757632:0@lo:253: 00000100:00100000:1.0:1787864629.087085:0:7439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.087126:0:7439:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a28eb106 going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.087220:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757632 00000100:00100000:3.0:1787864629.087228:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757632 00000100:00100000:3.0:1787864629.087278:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787864629.087286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008093ffc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7439:x1874711844757632:12345-0@lo:253: 20000000:01000000:3.0:1787864629.087310:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787864629.087324:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787864629.089311:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787864629.089378:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787864629.089397:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1787864629.089498:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787864629.089511:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787864629.089529:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089548:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089555:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089561:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089594:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089608:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 15 pid: 6504 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864629.089633:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aac7c7e8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844757760:0@lo:104: 00000100:00100000:3.0:1787864629.089698:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864629.089923:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864629.089932:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864629.089941:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844757888:0@lo:104: 00000100:00100000:3.0:1787864629.089964:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.089983:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e220ddc going to sleep for 11 seconds 00000100:00100000:1.0:1787864629.090046:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757760 00000100:00100000:1.0:1787864629.090053:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757760 00000100:00100000:1.0:1787864629.090085:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844757888 00000100:00100000:1.0:1787864629.090088:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844757888 00000100:00100000:1.0:1787864629.090102:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864629.090108:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b0c16bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844757760:12345-0@lo:104: 00010000:00010000:1.0:1787864629.090119:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090177:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864629.090182:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b0c16bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844757760:12345-0@lo:104: Request processed in 75us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.090189:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864629.090205:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864629.090210:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b450436d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844757888:12345-0@lo:104: 00010000:00010000:1.0:1787864629.090216:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090245:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864629.090249:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b450436d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844757888:12345-0@lo:104: Request processed in 41us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.090262:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787864629.090279:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864629.090284:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090291:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007a9fb8be already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864629.090294:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090301:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864629.090307:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864629.090312:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864629.090342:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090349:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864629.090366:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090373:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 000000007a9fb8be/0x2fcb8c294dc42f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f39 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090385:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864629.090388:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090403:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a9add8e1 already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864629.090406:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090412:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864629.090417:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864629.090421:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864629.090436:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090443:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864629.090447:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090452:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 00000000a9add8e1/0x2fcb8c294dc42e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e91 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.090464:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864629.090466:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864629.090467:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864629.090473:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864629.090483:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc328296 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844758016:0@lo:103: 00000100:00100000:1.0:1787864629.090511:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.090537:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864629.090543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ffb564f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844758144:0@lo:103: 00000100:00100000:1.0:1787864629.090575:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.090603:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758016 00000100:00100000:1.0:1787864629.090606:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758016 00000100:00100000:3.0:1787864629.090727:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aac7c7e8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844757760:0@lo:104: 00000100:00100000:3.0:1787864629.090825:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844757888:0@lo:104: 00010000:00010000:3.0:1787864629.090844:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091099:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 16 pid: 6504 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.091121:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758144 00000100:00100000:1.0:1787864629.091124:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758144 00010000:00010000:1.0:1787864629.091134:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 17 pid: 6503 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864629.091147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864629.091152:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c1a903a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3639:x1874711844758016:12345-0@lo:103: 00010000:00010000:1.0:1787864629.091161:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864629.091165:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 17 pid: 6504 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091172:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 17 pid: 6504 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091184:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000083db9336/0x2fcb8c294dc42f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f32 expref: 17 pid: 6504 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091196:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864629.091227:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c1a903a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3639:x1874711844758016:12345-0@lo:103: Request processed in 76us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.091234:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864629.091246:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864629.091252:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000175060f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3639:x1874711844758144:12345-0@lo:103: 00010000:00010000:1.0:1787864629.091259:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864629.091270:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091277:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091286:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f27333e0/0x2fcb8c294dc42e91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42e8a expref: 15 pid: 6503 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091296:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091302:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787864629.091316:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006644407s 00010000:00010000:1.0:1787864629.091319:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091325:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091329:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091333:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091338:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b62d4ea7 already unused, calling callback (000000001adf2aa7) 00010000:00010000:1.0:1787864629.091341:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091347:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091369:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091376:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864629.091399:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000175060f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3639:x1874711844758144:12345-0@lo:103: Request processed in 148us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864629.091405:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864629.091474:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ffb564f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844758144:0@lo:103: 00000100:00100000:1.0:1787864629.091481:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc328296 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844758016:0@lo:103: 00010000:00010000:1.0:1787864629.091498:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091503:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864629.091508:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42f71 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864629.095646:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008093ffc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:7439:x1874711844757632:12345-0@lo:253: Request processed in 8354us (8555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864629.095662:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864629.097201:0:7439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7439:1874711844757632:0@lo:253: 10000000:01000000:1.0:1787864629.097219:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787864629.097223:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787864629.097225:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787864629.097226:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864629.097227:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864629.097228:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864629.097229:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864629.097230:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787864629.097231:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787864629.097233:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787864629.097234:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864629.097246:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787864629.097260:0:7439:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787864629.103566:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.103796:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1787864629.104677:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.104928:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1787864629.105136:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.105832:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787864629.107314:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.107555:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787864629.108109:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.108270:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787864629.108462:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787864629.108824:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787864629.110851:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787864629.111183:0:7463:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1787864629.111233:0:7463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7463:1874711844758272:0@lo:700: 00000100:00100000:1.0:1787864629.111303:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864629.111362:0:7463:0:(client.c:2715:ptlrpc_set_wait()) set 00000000178ecd55 going to sleep for 11 seconds 00000100:00100000:0.0:1787864629.111430:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758272 00000100:00100000:0.0:1787864629.111437:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758272 00000100:00100000:0.0:1787864629.111490:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864629.111498:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc328296 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7463:x1874711844758272:12345-0@lo:700: 00000040:01000000:3.0:1787864629.111714:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1787864629.112243:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758400:0@lo:1000: 00000100:00100000:3.0:1787864629.112293:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.112368:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b634fc94 going to sleep for 11 seconds 00000040:01000000:1.0:1787864629.112825:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787864629.113024:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787864629.113458:0:7439:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787864629.113465:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787864629.113602:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787864629.114782:0:7462:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787864629.114796:0:7462:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787864629.115365:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1787864629.116160:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758400 00000100:00100000:0.0:1787864629.116170:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758400 00000100:00100000:0.0:1787864629.116222:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864629.116230:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aac7c7e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758400:12345-0@lo:1000: 00000100:00100000:0.0:1787864629.116347:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aac7c7e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758400:12345-0@lo:1000: Request processed in 117us (4055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864629.116354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864629.116401:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758400:0@lo:1000: 00000040:01000000:0.0:1787864629.116437:0:7464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1787864629.116474:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758528:0@lo:700: 00000100:00100000:0.0:1787864629.116509:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864629.116543:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758528 00000100:00100000:0.0:1787864629.116546:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758528 00000100:00100000:0.0:1787864629.116571:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864629.116577:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009440b574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758528:12345-0@lo:700: 00000100:00100000:0.0:1787864629.117310:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009440b574 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758528:12345-0@lo:700: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864629.117320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864629.117359:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071be5c6f going to sleep for 11 seconds 00000100:00100000:0.0:1787864629.117384:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758528:0@lo:700: 00000100:00100000:0.0:1787864629.117439:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7464:1874711844758656:0@lo:900: 00000100:00100000:0.0:1787864629.117471:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864629.117540:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071be5c6f going to sleep for 11 seconds 00000040:00080000:1.0:1787864629.118020:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787864629.119234:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787864629.119483:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787864629.119831:0:7439:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787864629.123126:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787864629.123361:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787864629.123505:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:2.0:1787864629.124975:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758656 00000100:00100000:2.0:1787864629.124989:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758656 00000100:00100000:2.0:1787864629.125036:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864629.125044:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016bd330b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7464:x1874711844758656:12345-0@lo:900: 00000100:00100000:2.0:1787864629.125141:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016bd330b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7464:x1874711844758656:12345-0@lo:900: Request processed in 98us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864629.125148:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787864629.125587:0:7464:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d17138e x1874711844758656/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864645 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864629.125602:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7464:1874711844758656:0@lo:900: 00000100:00100000:0.0:1787864629.125800:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758784:0@lo:1000: 00000100:00100000:0.0:1787864629.125844:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864629.125920:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023bc0fdb going to sleep for 11 seconds 00000100:00100000:2.0:1787864629.126607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844758784 00000100:00100000:2.0:1787864629.127005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844758784 00000100:00100000:2.0:1787864629.127054:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864629.127063:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8397bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758784:12345-0@lo:1000: 00000100:00100000:2.0:1787864629.127156:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8397bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844758784:12345-0@lo:1000: Request processed in 95us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864629.127163:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 40000000:02000000:0.0:1787864629.127238:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1787864629.127910:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787864629.128171:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787864629.128379:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787864629.128542:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:2.0:1787864629.131032:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844758784:0@lo:1000: 00000004:00080000:2.0:1787864629.131105:0:7464:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000071be5c6f with version 0 00000020:00100000:2.0:1787864629.131127:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787864629.131133:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000010a9b140 x1874711844759040/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787864629.131150:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000010a9b140 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844759040:0@lo:1000: 00000100:00100000:2.0:1787864629.131217:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864629.131262:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ce7b9b0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864629.131305:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759040 00000100:00100000:3.0:1787864629.131311:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759040 00000100:00100000:3.0:1787864629.131354:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864629.131361:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051a045ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844759040:12345-0@lo:1000: 00100000:10000000:1.0:1787864629.135056:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787864629.135262:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787864629.135420:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787864629.135559:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787864629.135809:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787864629.136054:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787864629.136200:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787864629.136389:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787864629.136537:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787864629.141234:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787864629.141390:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:0.0:1787864629.142941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc328296 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7463:x1874711844758272:12345-0@lo:700: Request processed in 31439us (31634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864629.142955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787864629.143805:0:7463:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007fb144ff x1874711844758272/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787864645 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864629.143822:0:7463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7463:1874711844758272:0@lo:700: 40000000:02000000:3.0:1787864629.143834:0:7463:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1787864629.147557:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1787864629.148402:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051a045ea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844759040:12345-0@lo:1000: Request processed in 17037us (17180us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787864629.148415:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1787864629.148461:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1787864629.148465:0:7464:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787864629.148477:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000010a9b140 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844759040:0@lo:1000: 00000100:00100000:0.0:1787864629.148564:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844759168:0@lo:1000: 00000100:00100000:0.0:1787864629.148601:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864629.148725:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759168 00000100:00100000:0.0:1787864629.148731:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759168 00000100:00100000:0.0:1787864629.148766:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864629.148773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096d656b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844759168:12345-0@lo:1000: 00000100:00100000:0.0:1787864629.148836:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096d656b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7464:x1874711844759168:12345-0@lo:1000: Request processed in 64us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864629.148842:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:1.0:1787864629.149044:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787864629.149281:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787864629.149420:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787864629.149568:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787864629.149712:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787864629.149847:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:0.0:1787864629.150060:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3bbdb08 going to sleep for 11 seconds 00000100:00100000:0.0:1787864629.150093:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009098f129 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7464:1874711844759168:0@lo:1000: 00000040:00080000:0.0:1787864629.150120:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787864629.150154:0:7464:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000071be5c6f with version 1 00100000:10000000:1.0:1787864629.150959:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787864629.151104:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787864629.151227:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787864629.151353:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787864629.151480:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787864629.151601:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787864629.151745:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787864629.151867:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787864629.152057:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:3.0:1787864629.154350:0:7454:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000027f4c322 version 1 rpc_version 1 00000020:00100000:3.0:1787864629.154401:0:7454:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787864629.154412:0:7454:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007fcc895d x1874711844759424/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864629.154433:0:7454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7454:1874711844759424:0@lo:1000: 00000100:00100000:3.0:1787864629.154502:0:7454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864629.157218:0:7454:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e74c838a going to sleep for 11 seconds 00000040:00080000:0.0:1787864629.158884:0:7464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787864629.158983:0:7464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787864629.159029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759424 00000100:00100000:0.0:1787864629.159038:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759424 00000100:00100000:0.0:1787864629.159090:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864629.159099:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bdfc32e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874711844759424:12345-0@lo:1000: 00000001:00080000:0.0:1787864629.162738:0:7439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787864629.162773:0:7439:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa20881a43988 00100000:10000000:0.0:1787864629.162780:0:7439:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787864629.164406:0:7439:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787864629.164439:0:7439:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787864629.164459:0:7439:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787864629.164494:0:7439:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787864629.165471:0:7439:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000001:00080000:1.0:1787864629.178596:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787864629.178803:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bdfc32e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7454:x1874711844759424:12345-0@lo:1000: Request processed in 19703us (24299us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787864629.178821:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1787864629.179800:0:7454:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1787864629.179808:0:7454:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787864629.179825:0:7454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fcc895d pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7454:1874711844759424:0@lo:1000: 00000020:00000004:1.0:1787864629.185819:0:7439:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1787864629.217011:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864629.243430:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787864629.243504:0:7463:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787864629.243510:0:7463:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1787864629.593507:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864630.618140:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864631.645721:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864632.666868:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864633.583975:0:7709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787864633.689380:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864634.137779:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864634.137800:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844759552:0@lo:41: 00000100:00100000:0.0:1787864634.138726:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864634.138793:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759552 00000100:00100000:0.0:1787864634.138801:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759552 00000100:00100000:0.0:1787864634.138870:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864634.138877:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009098f129 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844759552:12345-0@lo:41: 00000100:00100000:3.0:1787864634.139139:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844759680:0@lo:400: 00000100:00100000:3.0:1787864634.139188:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864634.139218:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f6b0823 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844759808:0@lo:400: 00000100:00100000:3.0:1787864634.139259:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864634.139277:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864634.139282:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c07aa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844759936:0@lo:400: 00000100:00100000:3.0:1787864634.139302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864634.139331:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759680 00000100:00100000:3.0:1787864634.139335:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759680 00000100:00100000:3.0:1787864634.139363:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787864634.139369:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a48f31e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:3638:x1874711844759680:12345-0@lo:400: 00000100:00100000:3.0:1787864634.139411:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a48f31e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:3638:x1874711844759680:12345-0@lo:400: Request processed in 42us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864634.139419:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787864634.139448:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759808 00000100:00100000:3.0:1787864634.139451:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759808 00000100:00100000:3.0:1787864634.139472:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844759936 00000100:00100000:3.0:1787864634.139475:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844759936 00000100:00100000:3.0:1787864634.139487:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864634.139492:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aeac764c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844759808:12345-0@lo:400: 00000100:00100000:3.0:1787864634.139524:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aeac764c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844759808:12345-0@lo:400: Request processed in 32us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864634.139530:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864634.139541:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864634.139553:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000064a96d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844759936:12345-0@lo:400: 00000100:00100000:3.0:1787864634.139579:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000064a96d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844759936:12345-0@lo:400: Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864634.139585:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00000024:0.0:1787864634.140442:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1787864634.141429:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0b87006 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844759680:0@lo:400: 00000100:00100000:0.0:1787864634.148016:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009098f129 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844759552:12345-0@lo:41: Request processed in 9133us (9286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864634.148029:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864634.149461:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844759552:0@lo:41: 00010000:00080000:3.0:1787864634.152083:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000c07aa80 x1874711844759936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864634.152101:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c07aa80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844759936:0@lo:400: 00010000:00080000:3.0:1787864634.152117:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009f6b0823 x1874711844759808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864634.152125:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f6b0823 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844759808:0@lo:400: 00000020:00000004:2.0:1787864634.397191:0:7761:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864634.397389:0:7761:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864634.713054:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864635.739372:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864636.764038:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787864637.184366:0:7863:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864637.184574:0:7863:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787864637.724922:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787864637.724929:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927547df8000 from 4 10000000:01000000:3.0:1787864637.724934:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787864637.725044:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.725058:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.725068:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864637.725088:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdec8171 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760064:0@lo:101: 00000100:00100000:3.0:1787864637.725305:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.725360:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20f7c07 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.725423:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760064 00000100:00100000:0.0:1787864637.725430:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760064 00000100:00100000:0.0:1787864637.725489:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864637.725496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005abfa69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:6508:x1874711844760064:12345-0@lo:101: 00010000:00010000:0.0:1787864637.725508:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864637.725520:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002479b29/0x2fcb8c294dc42f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f78 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.725541:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002479b29/0x2fcb8c294dc42f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.725550:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002479b29/0x2fcb8c294dc42f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.725558:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002479b29, rc 0) 00000100:00100000:0.0:1787864637.725609:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005abfa69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:6508:x1874711844760064:12345-0@lo:101: Request processed in 114us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.725616:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864637.725709:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdec8171 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760064:0@lo:101: 00010000:00010000:2.0:1787864637.725723:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.725731:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864637.725780:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c07e6f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760192:0@lo:256: 00000100:00100000:2.0:1787864637.725814:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864637.726271:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e863bdd going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.727846:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760192 00000100:00100000:3.0:1787864637.727865:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760192 00000100:00100000:3.0:1787864637.727936:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864637.730075:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d553ff9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:6508:x1874711844760192:12345-0@lo:256: 20000000:01000000:3.0:1787864637.730102:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787864637.730117:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787864637.730120:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787864637.730261:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d553ff9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:6508:x1874711844760192:12345-0@lo:256: Request processed in 195us (4446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.730269:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864637.730329:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c07e6f1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760192:0@lo:256: 10000000:01000000:3.0:1787864637.730376:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787864637.730385:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730395:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 0000000004ca1e76/0x2fcb8c294dc42f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864637.730405:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864637.730407:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927548600000 from 21 10000000:01000000:3.0:1787864637.730409:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864637.730435:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730442:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730449:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864637.730465:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760320:0@lo:101: 00000100:00100000:3.0:1787864637.730506:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.730532:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030e180b4 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.730547:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760320 00000100:00100000:3.0:1787864637.730552:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760320 00000100:00100000:3.0:1787864637.730578:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787864637.730582:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d77204e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:6508:x1874711844760320:12345-0@lo:101: 00010000:00010000:3.0:1787864637.730590:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864637.730599:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b80a0bc6/0x2fcb8c294dc42f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f86 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730616:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b80a0bc6/0x2fcb8c294dc42f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730625:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b80a0bc6/0x2fcb8c294dc42f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730632:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b80a0bc6, rc 0) 00000100:00100000:3.0:1787864637.730668:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d77204e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760320:12345-0@lo:101: Request processed in 85us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.730674:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787864637.730699:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760320:0@lo:101: 00010000:00010000:3.0:1787864637.730708:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.730715:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864637.730758:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760448:0@lo:501: 00000100:00100000:3.0:1787864637.730788:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.730800:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030e180b4 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.730810:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760448 00000100:00100000:3.0:1787864637.730813:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760448 00000100:00100000:3.0:1787864637.730829:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864637.730833:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c58c6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760448:12345-0@lo:501: 00000100:00100000:3.0:1787864637.731224:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c58c6cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760448:12345-0@lo:501: Request processed in 389us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.731232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864637.731263:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760448:0@lo:501: 00000100:00100000:3.0:1787864637.731288:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760576:0@lo:503: 00000100:00100000:3.0:1787864637.731326:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.731339:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030e180b4 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.731350:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760576 00000100:00100000:3.0:1787864637.731353:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760576 00000100:00100000:3.0:1787864637.731370:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864637.731375:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029612515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760576:12345-0@lo:503: 00000100:00100000:3.0:1787864637.731448:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029612515 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760576:12345-0@lo:503: Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.731455:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864637.731491:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760576:0@lo:503: 00000100:00100000:3.0:1787864637.733263:0:7887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7887:1874711844760704:0@lo:502: 00000100:00100000:3.0:1787864637.733328:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.733359:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760704 00000100:00100000:3.0:1787864637.733364:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760704 00000100:00100000:3.0:1787864637.733396:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787864637.733410:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058a87120 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7887:x1874711844760704:12345-0@lo:502: 00000100:00100000:3.0:1787864637.733507:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058a87120 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7887:x1874711844760704:12345-0@lo:502: Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.733514:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787864637.733557:0:7887:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20f7c07 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.733574:0:7887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7887:1874711844760704:0@lo:502: 00000100:00100000:3.0:1787864637.733614:0:7887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7887:1874711844760832:0@lo:502: 00000100:00100000:3.0:1787864637.733658:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.733678:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760832 00000100:00100000:3.0:1787864637.733681:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760832 00000100:00100000:3.0:1787864637.733697:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864637.733702:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ab1b9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7887:x1874711844760832:12345-0@lo:502: 00000100:00100000:3.0:1787864637.733756:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ab1b9d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:7887:x1874711844760832:12345-0@lo:502: Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.733762:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864637.733787:0:7887:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20f7c07 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.733798:0:7887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7887:1874711844760832:0@lo:502: 00000040:00080000:3.0:1787864637.733814:0:7887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787864637.733876:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787864637.733915:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864637.733923:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.733933:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000ab08ac14/0x2fcb8c294dc42f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864637.734490:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787864637.734497:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927548600000 from 4 10000000:01000000:3.0:1787864637.734500:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787864637.734524:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.734531:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864637.734538:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864637.734550:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760960:0@lo:101: 00000100:00100000:3.0:1787864637.734583:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.734614:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20f7c07 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.734730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844760960 00000100:00100000:0.0:1787864637.734735:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844760960 00000100:00100000:0.0:1787864637.736842:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787864637.736858:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000511577db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844760960:12345-0@lo:101: 00010000:00010000:0.0:1787864637.736876:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864637.736910:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000447ad984/0x2fcb8c294dc42f9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42f94 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.736946:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000447ad984/0x2fcb8c294dc42f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.736957:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000447ad984/0x2fcb8c294dc42f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.736976:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000447ad984, rc 0) 00000100:00100000:0.0:1787864637.737046:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000511577db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844760960:12345-0@lo:101: Request processed in 193us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.737052:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787864637.738776:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b329e1b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844760960:0@lo:101: 00010000:00010000:0.0:1787864637.738800:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.738811:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864637.739349:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761088:0@lo:256: 00000100:00100000:0.0:1787864637.739410:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864637.739449:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e61f8 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.739498:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761088 00000100:00100000:3.0:1787864637.739505:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761088 00000100:00100000:3.0:1787864637.739551:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864637.739558:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d75c338a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844761088:12345-0@lo:256: 20000000:01000000:3.0:1787864637.739576:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787864637.739591:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787864637.739594:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787864637.739689:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d75c338a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844761088:12345-0@lo:256: Request processed in 131us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.739697:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787864637.742078:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761088:0@lo:256: 10000000:01000000:0.0:1787864637.742141:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864637.742161:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742171:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 000000000a84a7f0/0x2fcb8c294dc42f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864637.742181:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787864637.742183:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787864637.742186:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864637.742216:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742230:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742238:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864637.742255:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761216:0@lo:101: 00000100:00100000:0.0:1787864637.742307:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864637.742340:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e61f8 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.742359:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761216 00000100:00100000:0.0:1787864637.742364:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761216 00000100:00100000:0.0:1787864637.742400:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787864637.742407:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009db984f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844761216:12345-0@lo:101: 00010000:00010000:0.0:1787864637.742418:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864637.742427:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42fa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42fa2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742446:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742455:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a9add8e1/0x2fcb8c294dc42fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742462:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a9add8e1, rc 0) 00000100:00100000:0.0:1787864637.742491:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009db984f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844761216:12345-0@lo:101: Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.742497:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787864637.742526:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761216:0@lo:101: 00010000:00010000:0.0:1787864637.742541:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.742548:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864637.742594:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761344:0@lo:501: 00000100:00100000:0.0:1787864637.742616:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864637.742626:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e61f8 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.742636:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761344 00000100:00100000:0.0:1787864637.742638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761344 00000100:00100000:0.0:1787864637.742668:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787864637.742673:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b70710de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844761344:12345-0@lo:501: 00000100:00100000:0.0:1787864637.742764:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b70710de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844761344:12345-0@lo:501: Request processed in 90us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.742770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787864637.742795:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761344:0@lo:501: 00000100:00100000:0.0:1787864637.742818:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761472:0@lo:503: 00000100:00100000:0.0:1787864637.742855:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864637.742867:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000004d3e61f8 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.742877:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761472 00000100:00100000:0.0:1787864637.742880:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761472 00000100:00100000:0.0:1787864637.742916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787864637.742920:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003067c5fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844761472:12345-0@lo:503: 00000100:00100000:0.0:1787864637.742989:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003067c5fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844761472:12345-0@lo:503: Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.742995:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787864637.743036:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844761472:0@lo:503: 00000100:00100000:3.0:1787864637.746404:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e27c782a pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7888:1874711844761600:0@lo:502: 00000100:00100000:3.0:1787864637.746485:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.746533:0:7888:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20f7c07 going to sleep for 11 seconds 00000100:00100000:1.0:1787864637.746585:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761600 00000100:00100000:1.0:1787864637.746591:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761600 00000100:00100000:1.0:1787864637.746639:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864637.746660:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e350126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:7888:x1874711844761600:12345-0@lo:502: 00000100:00100000:1.0:1787864637.746787:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e350126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:7888:x1874711844761600:12345-0@lo:502: Request processed in 128us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.746794:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787864637.747008:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e27c782a pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7888:1874711844761600:0@lo:502: 00000020:01000000:3.0:1787864637.747037:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864637.747051:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864637.747054:0:7888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1787864637.747059:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787864637.747062:0:7888:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:00000080:3.0:1787864637.747082:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864637.747102:0:7888:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000f73466f6) 00000020:00000080:3.0:1787864637.747123:0:7888:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1787864637.747129:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787864637.747283:0:7888:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1787864637.747288:0:7888:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787864637.747294:0:7888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc42fb7 00010000:00080000:3.0:1787864637.747322:0:7888:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006974b515@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864637.750829:0:7888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787864637.759064:0:7888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787864637.759079:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787864637.759109:0:7888:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787864637.759128:0:7888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc42fbe 00000100:00080000:1.0:1787864637.759137:0:7888:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864637.759142:0:7888:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000006974b515 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864637.759191:0:7888:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f880b71a x1874711844761728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864637.759221:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844761728:0@lo:38: 00000100:00100000:1.0:1787864637.759281:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.759334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761728 00000100:00100000:1.0:1787864637.759340:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761728 00000100:00100000:1.0:1787864637.759368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864637.759374:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b0f9a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874711844761728:12345-0@lo:38: 00010000:00080000:1.0:1787864637.759397:0:6516:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1787864637.759426:0:6516:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc42fc5 00000004:00100000:1.0:1787864637.759439:0:6516:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787864637.759444:0:6516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787864637.759508:0:7888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787864637.759576:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023cfbc2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844761856:0@lo:400: 00000100:00100000:1.0:1787864637.759604:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.759625:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864637.759630:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844761984:0@lo:400: 00000100:00100000:1.0:1787864637.759664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.759687:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c1a903a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844762112:0@lo:400: 00000100:00100000:1.0:1787864637.759709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.759748:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761856 00000100:00100000:1.0:1787864637.759752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761856 00000100:00100000:1.0:1787864637.759779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762112 00000100:00100000:1.0:1787864637.759782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762112 00000100:00100000:1.0:1787864637.759795:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864637.759801:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a9b9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844761856:12345-0@lo:400: 00000100:00100000:1.0:1787864637.759844:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a9b9eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844761856:12345-0@lo:400: Request processed in 44us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.759851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864637.759865:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864637.759870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f9d62c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844762112:12345-0@lo:400: 00000100:00100000:1.0:1787864637.759917:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f9d62c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844762112:12345-0@lo:400: Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.759923:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864637.759938:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787864637.759945:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:1.0:1787864637.760061:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000c1a903a x1874711844762112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864637.760075:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c1a903a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844762112:0@lo:400: 00010000:00080000:1.0:1787864637.760100:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000023cfbc2f x1874711844761856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864637.760107:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023cfbc2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844761856:0@lo:400: 00000040:01000000:1.0:1787864637.760133:0:7888:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1787864637.764601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844761984 00000100:00100000:1.0:1787864637.764613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844761984 00000100:00100000:0.0:1787864637.767750:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864637.767765:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032d798a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844761984:12345-0@lo:400: 00000100:00100000:0.0:1787864637.767861:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032d798a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844761984:12345-0@lo:400: Request processed in 99us (8196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864637.767868:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787864637.770012:0:7892:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000009d17138e x1874711844762240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864637.772066:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844761984:0@lo:400: 00000020:01000000:1.0:1787864637.772172:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864637.772185:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864637.772187:0:7888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787864637.772191:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864637.772196:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864637.772197:0:7888:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787864637.772200:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787864637.772202:0:7888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787864637.772234:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7888:1874711844762368:0@lo:502: 00000100:00100000:1.0:1787864637.772306:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.772336:0:7888:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194528ab going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.772596:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20d16d8 going to sleep for 0 seconds 00000100:00100000:3.0:1787864637.773177:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762368 00000100:00100000:3.0:1787864637.773183:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762368 00000100:00100000:3.0:1787864637.773229:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787864637.773236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f36ea8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:7888:x1874711844762368:12345-0@lo:502: 00000100:00100000:3.0:1787864637.773371:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f36ea8a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:7888:x1874711844762368:12345-0@lo:502: Request processed in 135us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.773378:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864637.773740:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b21b1c45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:7888:1874711844762368:0@lo:502: 00000020:01000000:1.0:1787864637.773766:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864637.773772:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864637.773774:0:7888:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787864637.773778:0:7888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:2.0:1787864637.780421:0:6516:0:(import.c:65:import_set_state_nolock()) 00000000f4fe6a67 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864637.780559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b0f9a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844761728:12345-0@lo:38: Request processed in 21183us (21277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864637.780570:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:0.0:1787864637.781980:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787864637.782015:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787864637.782024:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.782035:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 00000000d5d56967/0x2fcb8c294dc42fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864637.782044:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787864637.782047:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92755ed9ced8 from 1 10000000:01000000:0.0:1787864637.782049:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787864637.782082:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.782089:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864637.782099:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864637.782129:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844762496:0@lo:101: 00000100:00100000:0.0:1787864637.782198:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864637.782242:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000987a808e going to sleep for 11 seconds 00000100:00100000:2.0:1787864637.782434:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762496 00000100:00100000:2.0:1787864637.782441:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762496 00000100:00100000:2.0:1787864637.782487:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787864637.782495:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008c80f6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844762496:12345-0@lo:101: 00010000:00010000:2.0:1787864637.782506:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864637.782517:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9f4fcb9/0x2fcb8c294dc42fd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42fcc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.782545:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9f4fcb9/0x2fcb8c294dc42fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.782554:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9f4fcb9/0x2fcb8c294dc42fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.782563:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9f4fcb9, rc 0) 00000100:00100000:2.0:1787864637.782599:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008c80f6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844762496:12345-0@lo:101: Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864637.782606:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787864637.782658:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a42a5085 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844762496:0@lo:101: 00010000:00010000:2.0:1787864637.782669:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.782676:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864637.782727:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b688ab6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844762624:0@lo:501: 00000100:00100000:2.0:1787864637.782753:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864637.782768:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f60cb5a5 going to sleep for 11 seconds 00000100:00100000:2.0:1787864637.782780:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762624 00000100:00100000:2.0:1787864637.782784:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762624 00000100:00100000:2.0:1787864637.782805:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787864637.782810:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb939307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844762624:12345-0@lo:501: 00000100:00100000:2.0:1787864637.782886:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb939307 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844762624:12345-0@lo:501: Request processed in 76us (133us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864637.782919:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787864637.782966:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b688ab6e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844762624:0@lo:501: 10000000:01000000:2.0:1787864637.782988:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787864637.782992:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864637.782998:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: 0000000069fc14a5/0x2fcb8c294dc42fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864637.786122:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864637.786137:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787864637.786145:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787864637.786228:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787864637.786231:0:3636:0:(import.c:65:import_set_state_nolock()) 000000006974b515 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787864637.787170:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e20d16d8): req@000000009d17138e x1874711844762240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864637.787195:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844761728:0@lo:38: 00010000:00010000:1.0:1787864637.787256:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864637.787420:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.787462:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e20d16d8 going to sleep for 11 seconds 00000100:00100000:1.0:1787864637.787499:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762240 00000100:00100000:1.0:1787864637.787505:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762240 00000100:00100000:1.0:1787864637.787548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864637.787556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e27c782a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762240:12345-0@lo:1000: 00000100:00100000:1.0:1787864637.787622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e27c782a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762240:12345-0@lo:1000: Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.787636:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787864637.787706:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844762240:0@lo:1000: 00000040:01000000:3.0:1787864637.787735:0:7892:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787864637.787766:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bc51c61f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844762752:0@lo:1000: 00000100:00100000:3.0:1787864637.787793:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.787815:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 0000000030e180b4 going to sleep for 11 seconds 00000100:00100000:1.0:1787864637.788006:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762752 00000100:00100000:1.0:1787864637.788011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762752 00000100:00100000:1.0:1787864637.788038:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864637.788045:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fdf1de5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762752:12345-0@lo:1000: 00000100:00100000:1.0:1787864637.788135:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fdf1de5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762752:12345-0@lo:1000: Request processed in 92us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.788142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864637.788241:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bc51c61f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844762752:0@lo:1000: 00000100:00100000:1.0:1787864637.788277:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844762880:0@lo:700: 00000100:00100000:1.0:1787864637.788300:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.788325:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844762880 00000100:00100000:1.0:1787864637.788328:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844762880 00000100:00100000:1.0:1787864637.788347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864637.788352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b21b1c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762880:12345-0@lo:700: 00000100:00100000:1.0:1787864637.788380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b21b1c45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844762880:12345-0@lo:700: Request processed in 28us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.788385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864637.788398:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099b98d7a going to sleep for 11 seconds 00000100:00100000:1.0:1787864637.788408:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844762880:0@lo:700: 00000100:00100000:1.0:1787864637.788579:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763008:0@lo:1000: 00000100:00100000:1.0:1787864637.788605:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.788621:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 00000000194528ab going to sleep for 11 seconds 00000100:00100000:1.0:1787864637.788633:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763008 00000100:00100000:1.0:1787864637.788635:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763008 00000100:00100000:1.0:1787864637.788676:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864637.788687:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023cfbc2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844763008:12345-0@lo:1000: 00000100:00100000:1.0:1787864637.788731:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023cfbc2f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7892:x1874711844763008:12345-0@lo:1000: Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.788737:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864637.788761:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763008:0@lo:1000: 00000004:00080000:1.0:1787864637.788799:0:7892:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000099b98d7a with version 0 00000020:00100000:1.0:1787864637.788811:0:7892:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787864637.788817:0:7892:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f880b71a x1874711844763264/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864637.789142:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763264:0@lo:1000: 00000100:00100000:1.0:1787864637.789241:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.790048:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eb105093 going to sleep for 11 seconds 00000100:00100000:0.0:1787864637.792024:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864637.792042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844763392:0@lo:41: 00000100:00100000:0.0:1787864637.792105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864637.792627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763264 00000100:00100000:2.0:1787864637.792635:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763264 00000100:00100000:2.0:1787864637.792694:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763392 00000100:00100000:2.0:1787864637.792697:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763392 00000100:00100000:2.0:1787864637.792713:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864637.792720:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c1a903a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7892:x1874711844763264:12345-0@lo:1000: 00000100:00100000:1.0:1787864637.793570:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864637.793580:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a42a5085 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3639:x1874711844763392:12345-0@lo:41: 00000004:00000024:1.0:1787864637.793599:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787864637.793674:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a42a5085 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3639:x1874711844763392:12345-0@lo:41: Request processed in 96us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864637.793681:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864637.794105:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d17138e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844763392:0@lo:41: 00000001:00080000:1.0:1787864637.799079:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1787864637.799093:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787864637.799240:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c1a903a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7892:x1874711844763264:12345-0@lo:1000: Request processed in 6518us (9997us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787864637.799262:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1787864637.799387:0:7892:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787864637.799391:0:7892:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787864637.799403:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763264:0@lo:1000: 00000100:00100000:1.0:1787864637.799476:0:7892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763520:0@lo:1000: 00000100:00100000:1.0:1787864637.799510:0:7892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864637.799536:0:7892:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d99fd746 going to sleep for 11 seconds 00000100:00100000:3.0:1787864637.799574:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763520 00000100:00100000:3.0:1787864637.799580:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763520 00000100:00100000:3.0:1787864637.799615:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787864637.799622:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffb564f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7892:x1874711844763520:12345-0@lo:1000: 00000100:00100000:3.0:1787864637.799687:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffb564f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7892:x1874711844763520:12345-0@lo:1000: Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864637.799693:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864637.799743:0:7892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7892:1874711844763520:0@lo:1000: 00000040:00080000:1.0:1787864637.799755:0:7892:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787864637.799783:0:7892:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000eb105093 with version 1 00000004:00080000:3.0:1787864637.800904:0:7889:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000e20f7c07 version 1 rpc_version 1 00000020:00100000:3.0:1787864637.800930:0:7889:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787864637.801011:0:7889:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002cf1b5bf x1874711844763776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864637.801030:0:7889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002cf1b5bf pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7889:1874711844763776:0@lo:1000: 00000100:00100000:3.0:1787864637.801075:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864637.801113:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763776 00000100:00100000:3.0:1787864637.801119:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763776 00000100:00100000:3.0:1787864637.802132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787864637.802146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb01310f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7889:x1874711844763776:12345-0@lo:1000: 00000100:00100000:3.0:1787864637.802547:0:7889:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e82cd28 going to sleep for 11 seconds 00000040:00080000:1.0:1787864637.806666:0:7892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787864637.806746:0:7892:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787864637.806751:0:7892:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787864637.807275:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1787864637.807431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb01310f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7889:x1874711844763776:12345-0@lo:1000: Request processed in 5287us (6352us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787864637.807443:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1787864637.808303:0:7889:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1787864637.808310:0:7889:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787864637.808328:0:7889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002cf1b5bf pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7889:1874711844763776:0@lo:1000: 00000020:00000080:1.0:1787864638.035484:0:7917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc6a048f0 20000000:00000080:1.0:1787864638.035502:0:7917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92757d9ddc00 uarg=0000000000000000 20000000:01000000:1.0:1787864638.035542:0:7917:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787864638.035549:0:7917:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787864638.035554:0:7917:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787864638.035623:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787864638.035633:0:7917:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787864638.041081:0:7917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864638.041468:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787864638.041497:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787864638.041509:0:7917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787864638.041522:0:7917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787864638.041537:0:7917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041553:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041560:0:7917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041567:0:7917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041603:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041614:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 17 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864638.041626:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874711844763904:0@lo:104: 00000100:00100000:1.0:1787864638.041696:0:7917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864638.041756:0:7917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.041763:0:7917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 17 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864638.041771:0:7917:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874711844764032:0@lo:104: 00000100:00100000:1.0:1787864638.041787:0:7917:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5ed3707 going to sleep for 11 seconds 00000100:00100000:0.0:1787864638.041943:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787864638.041962:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864638.041988:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844763904 00000100:00100000:0.0:1787864638.041994:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844763904 00000100:00100000:0.0:1787864638.042025:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764032 00000100:00100000:0.0:1787864638.042028:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764032 00000100:00100000:0.0:1787864638.042040:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864638.042047:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e03185ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:7917:x1874711844763904:12345-0@lo:104: 00010000:00010000:0.0:1787864638.042056:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864638.042304:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864638.042310:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e03185ec pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:7917:x1874711844763904:12345-0@lo:104: Request processed in 263us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864638.042317:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864638.042352:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864638.042357:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d17138e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:7917:x1874711844764032:12345-0@lo:104: 00010000:00010000:0.0:1787864638.042369:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864638.042407:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787864638.042411:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d17138e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:7917:x1874711844764032:12345-0@lo:104: Request processed in 54us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864638.042416:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787864638.042557:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864638.042562:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042570:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002699e9f already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864638.042573:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042580:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864638.042586:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864638.042600:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864638.042634:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042650:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864638.042667:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042673:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 0000000002699e9f/0x2fcb8c294dc42f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f47 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042685:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864638.042687:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042691:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fc9e665 already unused, calling callback (00000000f9976640) 10000000:00010000:1.0:1787864638.042693:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042699:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864638.042704:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864638.042708:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864638.042729:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042734:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864638.042741:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042747:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: 000000008fc9e665/0x2fcb8c294dc42e52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42e59 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.042758:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864638.042760:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864638.042761:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864638.042766:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864638.042774:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a27a00d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764160:0@lo:103: 00000100:00100000:1.0:1787864638.042802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864638.042840:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864638.042845:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075430a9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764288:0@lo:103: 00000100:00100000:1.0:1787864638.042867:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864638.042940:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764160 00000100:00100000:1.0:1787864638.042944:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764160 00010000:00010000:1.0:1787864638.042962:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 18 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864638.042983:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764288 00000100:00100000:1.0:1787864638.042986:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764288 00010000:00010000:1.0:1787864638.042995:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 19 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864638.043006:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864638.043011:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006771a581 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3637:x1874711844764160:12345-0@lo:103: 00010000:00010000:1.0:1787864638.043020:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864638.043024:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 19 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043043:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 19 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043057:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864638.043084:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006771a581 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3637:x1874711844764160:12345-0@lo:103: Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864638.043090:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864638.043102:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864638.043106:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007875aa54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3637:x1874711844764288:12345-0@lo:103: 00010000:00010000:1.0:1787864638.043185:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864638.043189:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 18 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043198:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 18 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043208:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043214:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043225:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043231:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043236:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043247:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043265:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ffd8b005 already unused, calling callback (000000001adf2aa7) 00010000:00010000:1.0:1787864638.043268:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043274:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043281:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864638.043289:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864638.043311:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007875aa54 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3637:x1874711844764288:12345-0@lo:103: Request processed in 205us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864638.043317:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864638.043351:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075430a9d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764288:0@lo:103: 00000100:00100000:1.0:1787864638.043358:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a27a00d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764160:0@lo:103: 00010000:00010000:2.0:1787864638.044203:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe189d20/0x2fcb8c294dc42f47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f40 expref: 17 pid: 6505 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864638.044218:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f880b71a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874711844763904:0@lo:104: 00010000:00010000:2.0:1787864638.044228:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044cd55d1/0x2fcb8c294dc42e59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42e52 expref: 16 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864638.044235:0:7917:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fb144ff pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7917:1874711844764032:0@lo:104: 00010000:00010000:2.0:1787864638.044253:0:7917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864638.044260:0:7917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864638.044276:0:7917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864638.044281:0:7917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ffd8b005/0x2fcb8c294dc42fda lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864638.809719:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864639.258367:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864639.258390:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4c73a8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844764416:0@lo:41: 00000100:00100000:0.0:1787864639.258493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864639.258558:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764416 00000100:00100000:0.0:1787864639.258565:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764416 00000100:00100000:0.0:1787864639.258605:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864639.258612:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df5011b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844764416:12345-0@lo:41: 00000004:00000024:0.0:1787864639.258654:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1787864639.258694:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df5011b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844764416:12345-0@lo:41: Request processed in 82us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864639.258701:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864639.258744:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4c73a8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844764416:0@lo:41: 00010000:00010000:1.0:1787864639.838974:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864640.863389:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864641.882069:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864642.844374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4c73a8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844764544:0@lo:41: 00000100:00100000:0.0:1787864642.844440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864642.844504:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764544 00000100:00100000:0.0:1787864642.844510:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764544 00000100:00100000:0.0:1787864642.844551:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864642.844558:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e87e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844764544:12345-0@lo:41: 00000004:00000024:0.0:1787864642.844601:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787864642.844693:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e87e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844764544:12345-0@lo:41: Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864642.844700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864642.844745:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4c73a8a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844764544:0@lo:41: 00000100:00100000:3.0:1787864642.844987:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087f25b41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844764928:0@lo:400: 00000100:00100000:3.0:1787864642.845016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864642.845044:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864642.845049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000239921b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844765056:0@lo:400: 00000100:00100000:3.0:1787864642.845072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864642.845103:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b73a167f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764672:0@lo:400: 00000100:00100000:3.0:1787864642.845129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864642.845158:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864642.845164:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc2bd181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844764800:0@lo:400: 00000100:00100000:3.0:1787864642.845184:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864642.845209:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764928 00000100:00100000:3.0:1787864642.845213:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764928 00000100:00100000:3.0:1787864642.845237:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864642.845243:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001589fcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844764928:12345-0@lo:400: 00000100:00100000:3.0:1787864642.845280:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001589fcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844764928:12345-0@lo:400: Request processed in 37us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864642.845285:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864642.845302:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765056 00000100:00100000:3.0:1787864642.845305:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765056 00000100:00100000:3.0:1787864642.845324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764800 00000100:00100000:3.0:1787864642.845327:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764800 00000100:00100000:3.0:1787864642.845338:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864642.845343:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c07aa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844765056:12345-0@lo:400: 00000100:00100000:3.0:1787864642.845368:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c07aa80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844765056:12345-0@lo:400: Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864642.845374:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864642.845383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787864642.845387:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002cf1b5bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844764800:12345-0@lo:400: 00000100:00100000:3.0:1787864642.845411:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002cf1b5bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844764800:12345-0@lo:400: Request processed in 23us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864642.845416:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787864642.845429:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844764672 00000100:00100000:3.0:1787864642.845432:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844764672 00000100:00100000:3.0:1787864642.845458:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787864642.845463:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed0633eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3637:x1874711844764672:12345-0@lo:400: 00000100:00100000:3.0:1787864642.845494:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed0633eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3637:x1874711844764672:12345-0@lo:400: Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864642.845500:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787864642.845534:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000239921b5 x1874711844765056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864642.845545:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000239921b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844765056:0@lo:400: 00000100:00100000:3.0:1787864642.845553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087f25b41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844764928:0@lo:400: 00010000:00080000:3.0:1787864642.845576:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fc2bd181 x1874711844764800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864642.845584:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc2bd181 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844764800:0@lo:400: 00000100:00100000:3.0:1787864642.845590:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b73a167f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844764672:0@lo:400: 00010000:00010000:0.0:1787864642.905016:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864643.929045:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864644.380195:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8c8d843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844765184:0@lo:41: 00000100:00100000:3.0:1787864644.380270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864644.380381:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765184 00000100:00100000:1.0:1787864644.380389:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765184 00000100:00100000:1.0:1787864644.380438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864644.380445:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000939b2c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844765184:12345-0@lo:41: 00000004:00000024:1.0:1787864644.380474:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1787864644.380530:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000939b2c1a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844765184:12345-0@lo:41: Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864644.380537:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864644.380619:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8c8d843 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844765184:0@lo:41: 00010000:00010000:2.0:1787864644.954175:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864645.977208:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864646.426343:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864646.426353:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927547df8000 from 1 10000000:01000000:0.0:1787864646.426359:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864646.426417:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: 0000000092217f03/0x2fcb8c294dc42fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864646.426432:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: 0000000092217f03/0x2fcb8c294dc42fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864646.426443:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: 0000000092217f03/0x2fcb8c294dc42fe1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864646.426473:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765312:0@lo:101: 00000100:00100000:0.0:1787864646.426567:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864646.426645:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e914a52 going to sleep for 11 seconds 00000100:00100000:3.0:1787864646.428095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765312 00000100:00100000:3.0:1787864646.428111:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765312 00000100:00100000:3.0:1787864646.429235:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787864646.429253:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000431e834c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844765312:12345-0@lo:101: 00010000:00010000:3.0:1787864646.429278:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864646.429302:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42fe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42fe1 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.429336:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.429361:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b62d4ea7/0x2fcb8c294dc42fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.429372:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b62d4ea7, rc 0) 00000100:00100000:3.0:1787864646.429481:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000431e834c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765312:12345-0@lo:101: Request processed in 235us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864646.429488:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787864646.430624:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765312:0@lo:101: 00010000:00010000:0.0:1787864646.430653:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: 0000000092217f03/0x2fcb8c294dc42fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864646.430666:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: 0000000092217f03/0x2fcb8c294dc42fe1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864646.430763:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765440:0@lo:501: 00000100:00100000:0.0:1787864646.430833:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864646.431021:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e914a52 going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.436736:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765440 00000100:00100000:2.0:1787864646.436754:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765440 00000100:00100000:3.0:1787864646.437040:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787864646.437051:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000256648a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765440:12345-0@lo:501: 00000100:00100000:3.0:1787864646.437361:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000256648a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765440:12345-0@lo:501: Request processed in 310us (6528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864646.437371:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787864646.437740:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765440:0@lo:501: 00000100:00100000:0.0:1787864646.437805:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765568:0@lo:503: 00000100:00100000:0.0:1787864646.438157:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864646.438201:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e914a52 going to sleep for 11 seconds 00000100:00100000:3.0:1787864646.440947:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765568 00000100:00100000:3.0:1787864646.440965:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765568 00000100:00100000:3.0:1787864646.441034:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787864646.441043:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091f0d150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765568:12345-0@lo:503: 00000100:00100000:3.0:1787864646.441252:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091f0d150 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765568:12345-0@lo:503: Request processed in 210us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864646.441260:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864646.441583:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e67c6f8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765568:0@lo:503: 00000100:00100000:3.0:1787864646.451132:0:8379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc2bd181 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8379:1874711844765696:0@lo:502: 00000100:00100000:3.0:1787864646.451316:0:8379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864646.451424:0:8379:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e31c7dc going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.455061:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765696 00000100:00100000:2.0:1787864646.455084:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765696 00000100:00100000:2.0:1787864646.456266:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787864646.456284:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bec4c758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8379:x1874711844765696:12345-0@lo:502: 00000100:00100000:2.0:1787864646.459520:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bec4c758 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8379:x1874711844765696:12345-0@lo:502: Request processed in 3230us (8193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864646.459540:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864646.461774:0:8379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc2bd181 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8379:1874711844765696:0@lo:502: 00000020:01000000:0.0:1787864646.461817:0:8379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864646.461830:0:8379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864646.461833:0:8379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787864646.461841:0:8379:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff927547df8000 00000020:00000080:0.0:1787864646.461844:0:8379:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787864646.461921:0:8379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8379:1874711844765824:0@lo:502: 00000100:00100000:0.0:1787864646.461998:0:8379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864646.462052:0:8379:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864646.463533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765824 00000100:00100000:1.0:1787864646.463545:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765824 00000100:00100000:1.0:1787864646.465967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864646.465986:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8379:x1874711844765824:12345-0@lo:502: 00000100:00100000:1.0:1787864646.466154:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8379:x1874711844765824:12345-0@lo:502: Request processed in 175us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864646.466163:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787864646.466800:0:8379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8379:1874711844765824:0@lo:502: 00000020:01000000:2.0:1787864646.466872:0:8379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864646.466885:0:8379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864646.466933:0:8379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787864646.466939:0:8379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787864646.468044:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787864646.468077:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864646.468087:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.468114:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864646.468126:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864646.468128:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927548600000 from 1 10000000:01000000:3.0:1787864646.468131:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864646.468164:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.468172:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.468182:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864646.468261:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765952:0@lo:101: 00000100:00100000:3.0:1787864646.468321:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864646.468528:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844765952 00000100:00100000:2.0:1787864646.468542:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844765952 00000100:00100000:3.0:1787864646.468605:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.468630:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787864646.469517:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844765952:12345-0@lo:101: 00010000:00010000:2.0:1787864646.469542:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864646.469570:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc42fef expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864646.470435:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864646.470452:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864646.470465:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387aa00, rc 0) 00000100:00100000:2.0:1787864646.470579:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844765952:12345-0@lo:101: Request processed in 1936us (2257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864646.470588:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787864646.471338:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844765952:0@lo:101: 00010000:00010000:3.0:1787864646.471364:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864646.471377:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864646.471486:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844766080:0@lo:501: 00000100:00100000:3.0:1787864646.471534:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864646.471586:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053240 going to sleep for 11 seconds 00000100:00100000:0.0:1787864646.471610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766080 00000100:00100000:0.0:1787864646.471621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766080 00000100:00100000:0.0:1787864646.471680:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787864646.471690:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844766080:12345-0@lo:501: 00000100:00100000:0.0:1787864646.471841:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844766080:12345-0@lo:501: Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864646.471849:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864646.472393:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844766080:0@lo:501: 00000100:00100000:3.0:1787864646.472449:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844766208:0@lo:503: 00000100:00100000:3.0:1787864646.472527:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864646.472567:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.472636:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766208 00000100:00100000:2.0:1787864646.472644:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766208 00000100:00100000:2.0:1787864646.472862:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787864646.472872:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844766208:12345-0@lo:503: 00000100:00100000:2.0:1787864646.473011:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844766208:12345-0@lo:503: Request processed in 140us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864646.473018:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787864646.474001:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844766208:0@lo:503: 00000100:00100000:0.0:1787864646.476734:0:8382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8382:1874711844766336:0@lo:502: 00000100:00100000:0.0:1787864646.477299:0:8382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864646.477385:0:8382:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.477451:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766336 00000100:00100000:2.0:1787864646.477458:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766336 00000100:00100000:2.0:1787864646.477511:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787864646.477521:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8382:x1874711844766336:12345-0@lo:502: 00000100:00100000:2.0:1787864646.477950:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8382:x1874711844766336:12345-0@lo:502: Request processed in 430us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864646.477959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787864646.478112:0:8382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8382:1874711844766336:0@lo:502: 00000020:01000000:1.0:1787864646.478142:0:8382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864646.478152:0:8382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864646.478154:0:8382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787864646.478166:0:8382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff927548600000 00000020:00000080:1.0:1787864646.478170:0:8382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864646.478203:0:8382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8382:1874711844766464:0@lo:502: 00000100:00100000:1.0:1787864646.478251:0:8382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864646.478318:0:8382:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864646.478354:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766464 00000100:00100000:2.0:1787864646.478367:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766464 00000100:00100000:2.0:1787864646.478445:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787864646.478453:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8382:x1874711844766464:12345-0@lo:502: 00000100:00100000:2.0:1787864646.478534:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8382:x1874711844766464:12345-0@lo:502: Request processed in 81us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864646.478541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864646.478614:0:8382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8382:1874711844766464:0@lo:502: 00000020:01000000:1.0:1787864646.478632:0:8382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864646.478637:0:8382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864646.478639:0:8382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787864646.478644:0:8382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787864646.479156:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787864646.479183:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864646.479194:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864646.479207:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.005267:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864647.090634:0:8417:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787864647.090638:0:8417:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787864647.090639:0:8417:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787864647.090810:0:8417:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92757bdea800 00000020:01000004:2.0:1787864647.090825:0:8417:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787864647.090836:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787864647.090849:0:8417:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92757bdf1a48) 00000020:00000080:2.0:1787864647.090863:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787864647.130556:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787864647.130618:0:8417:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1787864647.168756:0:8417:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787864647.169260:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787864647.169273:0:8417:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787864647.169286:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2fcb8c294dc43004 00000020:01000004:2.0:1787864647.169294:0:8417:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787864647.169317:0:8417:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787864647.169321:0:8417:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787864647.169328:0:8417:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787864647.169333:0:8417:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787864647.169345:0:8417:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92757bdf4ed8) 00000020:00000080:2.0:1787864647.169370:0:8417:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1787864647.172689:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864647.174029:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787864647.174037:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787864647.186050:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787864647.186247:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787864647.186723:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787864647.186730:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787864647.189293:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864647.189493:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864647.189499:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787864647.197321:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864647.197335:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787864647.231263:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864647.231500:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787864647.231506:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787864647.234664:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787864647.234677:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787864647.237640:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787864647.237655:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787864647.243397:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864647.244549:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864647.244560:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787864647.245376:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864647.245385:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787864647.289530:0:8417:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864647.289856:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864647.289864:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787864647.291076:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864647.291086:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787864647.291604:0:8417:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787864647.291631:0:8417:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1787864647.291637:0:8417:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787864647.308662:0:8417:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787864647.308706:0:8417:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.136@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787864647.308710:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787864647.308712:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787864647.308714:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864647.308715:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864647.308716:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864647.308717:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864647.308718:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864647.308720:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864647.308721:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864647.308722:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864647.308724:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864647.308727:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787864647.308730:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787864647.308735:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787864647.308736:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864647.308737:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864647.308738:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864647.308740:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864647.308741:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864647.308741:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864647.308742:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864647.308743:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864647.308744:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864647.308827:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787864647.308845:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844766592:0@lo:253: 00000100:00100000:2.0:1787864647.308990:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.309171:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ecf56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864647.309331:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766592 00000100:00100000:3.0:1787864647.309338:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766592 00000100:00100000:3.0:1787864647.309381:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787864647.309389:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8417:x1874711844766592:12345-0@lo:253: 20000000:01000000:3.0:1787864647.309417:0:6503:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787864647.309421:0:6503:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787864647.309425:0:6503:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787864647.309429:0:6503:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787864647.309619:0:6503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864647.309765:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787864647.309780:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787864647.309798:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787864647.309803:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787864647.309816:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787864647.309828:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787864647.309938:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787864647.309952:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:3.0:1787864647.309954:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787864647.309968:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787864647.309974:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787864647.309988:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787864647.310010:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:3.0:1787864647.310025:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787864647.310031:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787864647.310043:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787864647.310056:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787864647.310147:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1787864647.310158:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:3.0:1787864647.310160:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787864647.310172:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1787864647.310177:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787864647.310189:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1787864647.310193:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:3.0:1787864647.310204:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1787864647.310209:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787864647.310222:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1787864647.310238:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1787864647.310604:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1787864647.310619:0:6503:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:3.0:1787864647.310620:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:3.0:1787864647.310636:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1787864647.310642:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787864647.310656:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1787864647.310662:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:3.0:1787864647.310674:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1787864647.310679:0:6503:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787864647.310690:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1787864647.310704:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1787864647.310717:0:6503:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787864647.310719:0:6503:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787864647.310722:0:6503:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787864647.310763:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787864647.310771:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787864647.311622:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1787864647.311657:0:8436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1787864647.311675:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787864647.312253:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787864647.312277:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787864647.312292:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787864647.312304:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787864647.312306:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864647.312675:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864647.312699:0:8437:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864647.312714:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787864647.313185:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787864647.313212:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787864647.313243:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787864647.313258:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787864647.313260:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864647.313624:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864647.313643:0:8438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864647.313657:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787864647.313870:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787864647.313987:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787864647.314007:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:2.0:1787864647.314018:0:6503:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787864647.314021:0:6503:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787864647.314496:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787864647.314654:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787864647.314675:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787864647.314688:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:2.0:1787864647.314702:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787864647.314722:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314750:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314816:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314825:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314832:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314838:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314844:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.314883:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.315232:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.315246:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766720:0@lo:104: 00000100:00100000:2.0:1787864647.315302:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864647.315386:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.315395:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 18 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.315411:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766848:0@lo:104: 00000100:00100000:2.0:1787864647.315432:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864647.315501:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.315510:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.315518:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766976:0@lo:104: 00000100:00100000:2.0:1787864647.315536:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.315585:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766720 00000100:00100000:0.0:1787864647.315599:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766720 00000100:00100000:0.0:1787864647.315632:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766848 00000100:00100000:0.0:1787864647.315635:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766848 00000100:00100000:0.0:1787864647.315647:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864647.315655:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6503:x1874711844766720:12345-0@lo:104: 00010000:00010000:0.0:1787864647.315666:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.315716:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864647.315723:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6503:x1874711844766720:12345-0@lo:104: Request processed in 69us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.315729:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864647.315745:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787864647.315843:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864647.315850:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.315864:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.315868:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.315877:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.315884:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.315909:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.315951:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.315958:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.315975:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.315983:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc42fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fd3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.315994:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.315996:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.315998:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864647.316016:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844767104:0@lo:103: 00000100:00100000:1.0:1787864647.316045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.316092:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767104 00000100:00100000:1.0:1787864647.316095:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767104 00010000:00010000:1.0:1787864647.316124:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.316151:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864647.316158:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3638:x1874711844767104:12345-0@lo:103: 00010000:00010000:1.0:1787864647.316168:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.316173:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316183:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316198:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.316224:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3638:x1874711844767104:12345-0@lo:103: Request processed in 67us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.316229:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864647.316263:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844767104:0@lo:103: 00000100:00100000:0.0:1787864647.316441:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6503:x1874711844766848:12345-0@lo:104: 00010000:00010000:0.0:1787864647.316451:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.316493:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864647.316498:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6503:x1874711844766848:12345-0@lo:104: Request processed in 742us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.316505:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787864647.316583:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864647.316588:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316606:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.316609:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316616:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.316622:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.316637:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.316663:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316669:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.316684:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316691:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031800/0x2fcb8c294dc42fa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fa9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316701:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.316702:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.316704:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864647.316715:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844767232:0@lo:103: 00000100:00100000:1.0:1787864647.316740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.316783:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767232 00000100:00100000:1.0:1787864647.316787:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767232 00010000:00010000:1.0:1787864647.316801:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.316820:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864647.316826:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3639:x1874711844767232:12345-0@lo:103: 00010000:00010000:1.0:1787864647.316833:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.316837:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316845:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 19 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.316863:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.316910:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3639:x1874711844767232:12345-0@lo:103: Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.316916:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864647.316940:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844767232:0@lo:103: 00010000:00010000:2.0:1787864647.317110:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.317121:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.317132:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844767360:0@lo:104: 00000100:00100000:2.0:1787864647.317156:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864647.317174:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.317182:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.317190:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844767488:0@lo:104: 00000100:00100000:2.0:1787864647.317211:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.317220:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ecf50c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787864647.317232:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387b400/0x2fcb8c294dc42fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42fcc expref: 18 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.317250:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766720:0@lo:104: 00010000:00010000:2.0:1787864647.317262:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030000/0x2fcb8c294dc42fa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42fa2 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.317271:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766848:0@lo:104: 00000100:00100000:1.0:1787864647.317379:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844766976 00000100:00100000:1.0:1787864647.317384:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844766976 00000100:00100000:1.0:1787864647.317402:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767360 00000100:00100000:1.0:1787864647.317404:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767360 00000100:00100000:1.0:1787864647.317412:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767488 00000100:00100000:1.0:1787864647.317413:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767488 00000100:00100000:1.0:1787864647.317423:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864647.317428:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6503:x1874711844766976:12345-0@lo:104: 00010000:00010000:1.0:1787864647.317436:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317481:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864647.317486:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6503:x1874711844766976:12345-0@lo:104: Request processed in 58us (1949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.317492:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864647.317504:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864647.317510:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6503:x1874711844767360:12345-0@lo:104: 00010000:00010000:1.0:1787864647.317517:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317547:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864647.317552:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6503:x1874711844767360:12345-0@lo:104: Request processed in 43us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.317564:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864647.317576:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864647.317582:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6503:x1874711844767488:12345-0@lo:104: 00010000:00010000:1.0:1787864647.317600:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317628:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787864647.317633:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6503:x1874711844767488:12345-0@lo:104: Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.317639:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787864647.317653:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787864647.317657:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317664:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.317667:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317675:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.317682:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.317687:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.317703:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317709:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.317726:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317732:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc42f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f8d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317744:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864647.317747:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317752:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.317763:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317770:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.317776:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.317781:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.317794:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317800:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.317810:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317817:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc42f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f55 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317826:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864647.317833:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317838:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.317841:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317847:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.317853:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.317857:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.317870:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317875:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.317880:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317911:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc42ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ede expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.317924:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.317926:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.317928:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864647.317938:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844767616:0@lo:103: 00000100:00100000:1.0:1787864647.317963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.317989:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767616 00000100:00100000:1.0:1787864647.317993:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767616 00010000:00010000:1.0:1787864647.318013:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.318031:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864647.318038:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3640:x1874711844767616:12345-0@lo:103: 00010000:00010000:1.0:1787864647.318046:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.318049:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318058:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318069:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.318094:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3640:x1874711844767616:12345-0@lo:103: Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.318292:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864647.318315:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844767744:0@lo:103: 00000100:00100000:1.0:1787864647.318341:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.318359:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864647.318364:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844767872:0@lo:103: 00000100:00100000:1.0:1787864647.318386:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.318417:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844767616:0@lo:103: 00000100:00100000:1.0:1787864647.318440:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767744 00000100:00100000:1.0:1787864647.318443:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767744 00010000:00010000:1.0:1787864647.318456:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.318468:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844767872 00000100:00100000:1.0:1787864647.318471:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844767872 00010000:00010000:1.0:1787864647.318488:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.318499:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864647.318504:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3637:x1874711844767744:12345-0@lo:103: 00010000:00010000:1.0:1787864647.318512:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.318516:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318524:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 18 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318534:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.318558:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3637:x1874711844767744:12345-0@lo:103: Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.318565:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864647.318576:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864647.318582:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3637:x1874711844767872:12345-0@lo:103: 00010000:00010000:1.0:1787864647.318601:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.318606:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318615:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318626:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318634:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318657:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318665:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318672:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318678:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318682:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864647.318686:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318693:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318701:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.318710:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.318732:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3637:x1874711844767872:12345-0@lo:103: Request processed in 150us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.318738:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787864647.318937:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864647.318983:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844767872:0@lo:103: 00000100:00100000:1.0:1787864647.318991:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844767744:0@lo:103: 00010000:00010000:2.0:1787864647.319113:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582172600/0x2fcb8c294dc42f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f86 expref: 16 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.319124:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844766976:0@lo:104: 00010000:00010000:2.0:1787864647.319134:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387b800/0x2fcb8c294dc42f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f4e expref: 15 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.319142:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844767360:0@lo:104: 00010000:00010000:2.0:1787864647.319151:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387a200/0x2fcb8c294dc42ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42ed7 expref: 14 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.319160:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6503:1874711844767488:0@lo:104: 00010000:00010000:2.0:1787864647.319180:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.319189:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.319196:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.319202:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387a400/0x2fcb8c294dc43012 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864647.319221:0:6503:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787864647.321929:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:8417:x1874711844766592:12345-0@lo:253: Request processed in 12533us (12932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.321943:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787864647.322261:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844766592:0@lo:253: 10000000:01000000:0.0:1787864647.322276:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787864647.322279:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787864647.322280:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787864647.322281:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864647.322283:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787864647.322284:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864647.322285:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864647.322286:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864647.322288:0:8417:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787864647.322290:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864647.322291:0:8417:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787864647.322309:0:8417:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92757bdea800 from lustre-OST0000 10000000:01000000:0.0:1787864647.322337:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787864647.322340:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787864647.322347:0:8417:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92755ed9ced8 local copy 10000000:01000000:0.0:1787864647.322351:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787864647.322386:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.322396:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.322420:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864647.322438:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768000:0@lo:101: 00000100:00100000:0.0:1787864647.322474:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.322511:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.322559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768000 00000100:00100000:2.0:1787864647.322564:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768000 00000100:00100000:2.0:1787864647.322612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787864647.322621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:8417:x1874711844768000:12345-0@lo:101: 00010000:00010000:2.0:1787864647.322632:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864647.322658:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43019 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.322681:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43019 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.322691:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43019 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.322700:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:2.0:1787864647.322872:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768000:12345-0@lo:101: Request processed in 252us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.322879:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787864647.323533:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768000:0@lo:101: 00010000:00010000:3.0:1787864647.323549:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.323559:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864647.323666:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768128:0@lo:501: 00000100:00100000:3.0:1787864647.323703:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.323781:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.324181:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768128 00000100:00100000:2.0:1787864647.324187:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768128 00000100:00100000:2.0:1787864647.324259:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864647.324268:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768128:12345-0@lo:501: 00000100:00100000:2.0:1787864647.324346:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768128:12345-0@lo:501: Request processed in 79us (642us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864647.324362:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787864647.324431:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768128:0@lo:501: 10000000:01000000:3.0:1787864647.324445:0:8417:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787864647.324465:0:8417:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787864647.324471:0:8417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.324480:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.324487:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.324509:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787864647.324537:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92757bdea800 10000000:01000000:3.0:1787864647.324542:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787864647.324555:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787864647.324557:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864647.324562:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787864647.324564:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787864647.324587:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.324606:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.324614:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864647.324629:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768256:0@lo:101: 00000100:00100000:3.0:1787864647.324663:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864647.324705:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864647.324716:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.324723:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030e00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864647.324727:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.324735:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864647.324742:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864647.324748:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864647.324779:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.324785:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864647.324802:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.324809:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc43019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43020 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.324819:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.324821:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864647.324822:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864647.324830:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864647.324840:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844768384:0@lo:103: 00000100:00100000:1.0:1787864647.324868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.324924:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768384 00000100:00100000:1.0:1787864647.324934:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768384 00000100:00100000:1.0:1787864647.324967:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864647.324974:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3640:x1874711844768384:12345-0@lo:103: 00010000:00010000:1.0:1787864647.324984:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864647.324996:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43019 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.325008:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864647.325037:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:3640:x1874711844768384:12345-0@lo:103: Request processed in 63us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.325043:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864647.325083:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844768384:0@lo:103: 00000100:00100000:3.0:1787864647.325441:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864647.325491:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768256 00000100:00100000:0.0:1787864647.325496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768256 00000100:00100000:0.0:1787864647.325522:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787864647.325528:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+13:8417:x1874711844768256:12345-0@lo:101: 00010000:00010000:0.0:1787864647.325537:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864647.325550:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43027 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.325566:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.325576:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.325582:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:0.0:1787864647.325673:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768256:12345-0@lo:101: Request processed in 144us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.325680:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864647.325824:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768256:0@lo:101: 00010000:00010000:3.0:1787864647.325838:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.325847:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864647.326232:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768512:0@lo:501: 00000100:00100000:3.0:1787864647.326263:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.326327:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864647.326367:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768512 00000100:00100000:0.0:1787864647.326372:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768512 00000100:00100000:0.0:1787864647.326432:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787864647.326439:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768512:12345-0@lo:501: 00000100:00100000:0.0:1787864647.326563:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768512:12345-0@lo:501: Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.326571:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864647.326655:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768512:0@lo:501: 00000100:00100000:3.0:1787864647.326682:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768640:0@lo:503: 00000100:00100000:3.0:1787864647.326728:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.326918:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.327262:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768640 00000100:00100000:2.0:1787864647.327267:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768640 00000100:00100000:2.0:1787864647.327292:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787864647.327299:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768640:12345-0@lo:503: 00000100:00100000:2.0:1787864647.327393:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768640:12345-0@lo:503: Request processed in 93us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.327399:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787864647.327503:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768640:0@lo:503: 00000040:00080000:3.0:1787864647.327755:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864647.327837:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768768:0@lo:502: 00000100:00100000:3.0:1787864647.327877:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.327926:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.328040:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768768 00000100:00100000:2.0:1787864647.328045:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768768 00000100:00100000:2.0:1787864647.328076:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787864647.328083:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768768:12345-0@lo:502: 00000100:00100000:2.0:1787864647.328177:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768768:12345-0@lo:502: Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.328185:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864647.328334:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768768:0@lo:502: 00000040:00080000:3.0:1787864647.328535:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787864647.328560:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787864647.328575:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787864647.328588:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787864647.328615:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787864647.328627:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787864647.328647:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768896:0@lo:502: 00000100:00100000:3.0:1787864647.328682:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.328707:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544de4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.328875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844768896 00000100:00100000:2.0:1787864647.328880:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844768896 00000100:00100000:2.0:1787864647.328939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787864647.328946:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768896:12345-0@lo:502: 00000100:00100000:2.0:1787864647.329012:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844768896:12345-0@lo:502: Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.329019:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787864647.329123:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844768896:0@lo:502: 00000040:00080000:3.0:1787864647.329162:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787864647.329171:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787864647.329719:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787864647.329728:0:8440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787864647.329733:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864647.329736:0:8440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787864647.329741:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864647.329755:0:8440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92757bc30000) 00000020:00000080:3.0:1787864647.329846:0:8440:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787864647.329853:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787864647.329959:0:8440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757bdea800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787864647.329967:0:8440:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787864647.329974:0:8440:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2fcb8c294dc4303c 00010000:00010000:3.0:1787864647.335579:0:8440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787864647.336258:0:8440:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787864647.339400:0:8440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787864647.339716:0:8440:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787864647.344567:0:8440:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787864647.345022:0:8440:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787864647.350706:0:8440:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787864647.355841:0:8440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787864647.355853:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864647.355860:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864647.355862:0:8440:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787864647.355866:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864647.355876:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864647.355878:0:8440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787864647.355881:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787864647.355883:0:8440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787864647.355925:0:8440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864647.355928:0:8440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864647.355930:0:8440:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787864647.355933:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787864647.356262:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787864647.356290:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787864647.356312:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.356324:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864647.356331:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757bdea800 from 1 10000000:01000000:0.0:1787864647.356334:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864647.356365:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.356372:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.356381:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864647.356401:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769024:0@lo:101: 00000100:00100000:0.0:1787864647.356463:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.356494:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.357254:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769024 00000100:00100000:2.0:1787864647.357262:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769024 00000100:00100000:2.0:1787864647.357315:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864647.357324:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:8417:x1874711844769024:12345-0@lo:101: 00010000:00010000:2.0:1787864647.357337:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864647.357351:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43043 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.357374:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.357385:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.357393:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797a00, rc 0) 00000100:00100000:2.0:1787864647.357440:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769024:12345-0@lo:101: Request processed in 117us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.357448:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787864647.359468:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769024:0@lo:101: 00010000:00010000:0.0:1787864647.359494:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.359518:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864647.359642:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769152:0@lo:501: 00000100:00100000:0.0:1787864647.359691:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.359780:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.360511:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769152 00000100:00100000:2.0:1787864647.360519:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769152 00000100:00100000:2.0:1787864647.360612:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787864647.360622:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769152:12345-0@lo:501: 00000100:00100000:2.0:1787864647.360751:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769152:12345-0@lo:501: Request processed in 131us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.360777:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787864647.360848:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769152:0@lo:501: 00000100:00100000:3.0:1787864647.360938:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769280:0@lo:503: 00000100:00100000:3.0:1787864647.361880:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.362158:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864647.362337:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769280 00000100:00100000:0.0:1787864647.362344:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769280 00000100:00100000:0.0:1787864647.362381:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787864647.362389:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769280:12345-0@lo:503: 00000100:00100000:0.0:1787864647.362519:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769280:12345-0@lo:503: Request processed in 129us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.362526:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787864647.362662:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769280:0@lo:503: 00000040:00080000:3.0:1787864647.362951:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864647.363044:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769408:0@lo:502: 00000100:00100000:3.0:1787864647.363274:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.363304:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864647.363377:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769408 00000100:00100000:0.0:1787864647.363383:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769408 00000100:00100000:0.0:1787864647.363414:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787864647.363421:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769408:12345-0@lo:502: 00000100:00100000:0.0:1787864647.363509:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769408:12345-0@lo:502: Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.363516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787864647.363648:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769408:0@lo:502: 00000040:00080000:3.0:1787864647.363831:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787864647.363857:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787864647.363879:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769536:0@lo:502: 00000100:00100000:3.0:1787864647.363961:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.363985:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.364109:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769536 00000100:00100000:2.0:1787864647.364114:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769536 00000100:00100000:2.0:1787864647.364149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787864647.364157:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769536:12345-0@lo:502: 00000100:00100000:2.0:1787864647.364230:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769536:12345-0@lo:502: Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.364236:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787864647.364495:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769536:0@lo:502: 00000040:00080000:3.0:1787864647.364535:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787864647.364551:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787864647.365331:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864647.365339:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864647.365342:0:8444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787864647.365348:0:8444:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92757bdea800 00000020:00000080:3.0:1787864647.365351:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864647.365362:0:8444:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864647.365365:0:8444:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864647.365366:0:8444:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787864647.365368:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787864647.365527:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787864647.365552:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864647.365618:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.365631:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864647.365677:0:8417:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787864647.365680:0:8417:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92757bdea800 10000000:01000000:2.0:1787864647.365683:0:8417:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92757bdea800 10000000:01000000:2.0:1787864647.365688:0:8417:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864647.365694:0:8417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92757bdea800 from 1 10000000:01000000:2.0:1787864647.365697:0:8417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864647.365725:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.365733:0:8417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.365743:0:8417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.365781:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769664:0@lo:101: 00000100:00100000:2.0:1787864647.365827:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.365922:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ecf5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787864647.366251:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769664 00000100:00100000:3.0:1787864647.366258:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769664 00000100:00100000:3.0:1787864647.366332:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787864647.366343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8417:x1874711844769664:12345-0@lo:101: 00010000:00010000:3.0:1787864647.366357:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864647.366370:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43051 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.366392:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.366403:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.366412:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927582172c00, rc 0) 00000100:00100000:3.0:1787864647.366465:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844769664:12345-0@lo:101: Request processed in 124us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864647.366472:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787864647.366539:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769664:0@lo:101: 00010000:00010000:0.0:1787864647.366553:0:8417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864647.366563:0:8417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864647.366681:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769792:0@lo:501: 00000100:00100000:0.0:1787864647.366710:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.366908:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.367001:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769792 00000100:00100000:2.0:1787864647.367006:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769792 00000100:00100000:2.0:1787864647.367029:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787864647.367036:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844769792:12345-0@lo:501: 00000100:00100000:2.0:1787864647.367294:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844769792:12345-0@lo:501: Request processed in 257us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.367301:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787864647.367365:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769792:0@lo:501: 00000100:00100000:0.0:1787864647.367413:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769920:0@lo:503: 00000100:00100000:0.0:1787864647.367451:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.367472:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.367508:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844769920 00000100:00100000:2.0:1787864647.367512:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844769920 00000100:00100000:2.0:1787864647.367528:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864647.367533:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844769920:12345-0@lo:503: 00000100:00100000:2.0:1787864647.367613:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844769920:12345-0@lo:503: Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.367620:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787864647.367677:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844769920:0@lo:503: 00000040:00080000:0.0:1787864647.367974:0:8417:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787864647.368033:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844770048:0@lo:502: 00000100:00100000:0.0:1787864647.368077:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.368092:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864647.368253:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770048 00000100:00100000:3.0:1787864647.368258:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770048 00000100:00100000:3.0:1787864647.368285:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787864647.368298:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844770048:12345-0@lo:502: 00000100:00100000:3.0:1787864647.368413:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844770048:12345-0@lo:502: Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864647.368419:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787864647.368574:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844770048:0@lo:502: 00000040:00080000:0.0:1787864647.368816:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787864647.368847:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787864647.368863:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787864647.368875:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787864647.369313:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787864647.369346:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787864647.369359:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787864647.369370:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787864647.369381:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787864647.369391:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787864647.369401:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787864647.369412:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787864647.369422:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787864647.369440:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787864647.369450:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787864647.369460:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787864647.369470:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787864647.369481:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787864647.369491:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787864647.369502:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787864647.369512:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787864647.369530:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787864647.369542:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787864647.369553:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787864647.369564:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1787864647.369575:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1787864647.369585:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1787864647.369610:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1787864647.369622:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1787864647.369633:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1787864647.369643:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1787864647.369655:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1787864647.369669:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1787864647.369681:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1787864647.369695:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1787864647.369709:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1787864647.369721:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1787864647.369814:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844770176:0@lo:502: 00000100:00100000:0.0:1787864647.369867:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.370097:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864647.370324:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770176 00000100:00100000:3.0:1787864647.370330:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770176 00000100:00100000:3.0:1787864647.370372:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787864647.370380:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844770176:12345-0@lo:502: 00000100:00100000:3.0:1787864647.370485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844770176:12345-0@lo:502: Request processed in 106us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864647.370492:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787864647.370605:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844770176:0@lo:502: 00000040:00080000:1.0:1787864647.370686:0:8417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787864647.370697:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787864647.371246:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787864647.371259:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92757bdf3490) 00000020:00000080:2.0:1787864647.371279:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787864647.371358:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757bdea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864647.371362:0:8445:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757bdea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864647.371365:0:8445:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757bdea800 3 00010000:00080000:2.0:1787864647.371392:0:8445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757da99000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864647.373370:0:8445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1787864647.373585:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787864647.373642:0:8445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787864647.373652:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2fcb8c294dc43066 00000100:00080000:2.0:1787864647.373661:0:8445:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864647.373667:0:8445:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92757da99000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864647.373697:0:8445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558ab8b40 x1874711844770304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864647.373769:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844770304:0@lo:38: 00000100:00100000:3.0:1787864647.373836:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.375052:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770304 00000100:00100000:0.0:1787864647.375061:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770304 00000100:00100000:0.0:1787864647.375220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864647.375228:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844770304:12345-0@lo:38: 00010000:00080000:0.0:1787864647.375257:0:6510:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1787864647.375295:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2fcb8c294dc4306d 00000004:00100000:0.0:1787864647.375312:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864647.375346:0:6510:0:(import.c:65:import_set_state_nolock()) ffff92744679e000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787864647.375637:0:8445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787864647.375933:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844770432:0@lo:400: 00000100:00100000:1.0:1787864647.376168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.376204:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864647.376210:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844770816:0@lo:400: 00000100:00100000:1.0:1787864647.376239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.376267:0:6512:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787864647.376277:0:6512:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787864647.376294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770816 00000100:00100000:1.0:1787864647.376299:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770816 00000100:00100000:1.0:1787864647.376332:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864647.376339:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844770816:12345-0@lo:400: 00000100:00100000:1.0:1787864647.376382:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844770816:12345-0@lo:400: Request processed in 43us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.376396:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864647.376431:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844770688:0@lo:400: 00000100:00100000:1.0:1787864647.376458:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.376472:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864647.376476:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844770560:0@lo:400: 00000100:00100000:1.0:1787864647.376496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864647.376522:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770560 00000100:00100000:1.0:1787864647.376526:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770560 00000100:00100000:1.0:1787864647.376548:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864647.376554:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844770560:12345-0@lo:400: 00000100:00100000:1.0:1787864647.376587:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844770560:12345-0@lo:400: Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864647.376605:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864647.376646:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844770816:0@lo:400: 00000100:00100000:1.0:1787864647.376671:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844770560:0@lo:400: 00000100:00100000:0.0:1787864647.377048:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874711844770304:12345-0@lo:38: Request processed in 1818us (3210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.377058:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864647.377083:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770432 00000100:00100000:0.0:1787864647.377100:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770432 00000100:00100000:0.0:1787864647.377118:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770688 00000100:00100000:0.0:1787864647.377121:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770688 00000100:00100000:0.0:1787864647.377134:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864647.377140:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844770432:12345-0@lo:400: 00000100:00100000:0.0:1787864647.377199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844770432:12345-0@lo:400: Request processed in 59us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.377205:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864647.377221:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864647.377228:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844770688:12345-0@lo:400: 00010000:00080000:2.0:1787864647.377241:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558ab8000 x1874711844770432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864647.377253:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844770432:0@lo:400: 00000100:00100000:0.0:1787864647.377265:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844770688:12345-0@lo:400: Request processed in 37us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.377272:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787864647.377310:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558ab8b40 x1874711844770304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864647.377320:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1787864647.377325:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558aba580 x1874711844770688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864647.377328:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787864647.377339:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:0.0:1787864647.377340:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844770688:0@lo:400: 00000100:00080000:3.0:1787864647.377348:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787864647.377352:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787864647.377361:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844770304:0@lo:38: 00000020:01000004:2.0:1787864647.380001:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787864647.380032:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff927446ff1a48) 00000020:00000080:2.0:1787864647.380054:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1787864647.380242:0:8445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757bdea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864647.380247:0:8445:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757bdea800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864647.380249:0:8445:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757bdea800 3 00010000:00080000:2.0:1787864647.380278:0:8445:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757da9b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864647.385025:0:8445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1787864647.385942:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787864647.385985:0:8445:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787864647.385999:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2fcb8c294dc4307b 00000100:00080000:2.0:1787864647.386009:0:8445:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864647.386015:0:8445:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff92757da9b800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864647.386048:0:8445:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558ab8000 x1874711844770944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864647.386076:0:8445:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787864647.386260:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844770944:0@lo:38: 00000100:00100000:3.0:1787864647.386324:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.386499:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844770944 00000100:00100000:0.0:1787864647.386506:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844770944 00000100:00100000:0.0:1787864647.386542:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864647.386550:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844770944:12345-0@lo:38: 00010000:00080000:0.0:1787864647.386581:0:6510:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1787864647.386632:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2fcb8c294dc43082 00000004:00100000:0.0:1787864647.386645:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864647.386674:0:6510:0:(import.c:65:import_set_state_nolock()) ffff92744679a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864647.386725:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874711844770944:12345-0@lo:38: Request processed in 174us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.386733:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787864647.386867:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558ab8000 x1874711844770944/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864647.386877:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864647.386884:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787864647.386911:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787864647.386916:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787864647.386918:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757da9b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864647.386924:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844770944:0@lo:38: 00000040:00080000:2.0:1787864647.387401:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787864647.387552:0:8417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787864647.387579:0:8417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864647.387605:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864647.387621:0:8417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787864647.387665:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787864647.387667:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864647.387668:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864647.387669:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864647.387671:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864647.387672:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864647.387673:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864647.387675:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864647.387676:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864647.387678:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864647.387679:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864647.387682:0:8417:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787864647.387685:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864647.387686:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864647.387687:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864647.387688:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864647.387689:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864647.387690:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864647.387691:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864647.387692:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864647.387693:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864647.387694:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864647.387695:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864647.387714:0:8417:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787864647.387729:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844771072:0@lo:253: 00000100:00100000:3.0:1787864647.387784:0:8417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864647.387815:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864647.388995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771072 00000100:00100000:0.0:1787864647.389003:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771072 00000100:00100000:0.0:1787864647.389053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787864647.389071:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844771072:12345-0@lo:253: 20000000:01000000:0.0:1787864647.389222:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787864647.389237:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787864647.397732:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787864647.397833:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787864647.398776:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:8417:x1874711844771072:12345-0@lo:253: Request processed in 9710us (10986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.398790:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 20000000:01000000:1.0:1787864647.399058:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787864647.399073:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787864647.399093:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399115:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399122:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399129:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399176:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399189:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 15 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.399203:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844771200:0@lo:104: 00000100:00100000:1.0:1787864647.399244:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864647.399280:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864647.399290:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 15 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864647.399298:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844771328:0@lo:104: 00000100:00100000:1.0:1787864647.399315:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275456689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864647.399498:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864647.399516:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.399548:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771200 00000100:00100000:2.0:1787864647.399554:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771200 00000100:00100000:2.0:1787864647.399583:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771328 00000100:00100000:2.0:1787864647.399586:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771328 00000100:00100000:2.0:1787864647.399609:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864647.399617:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844771200:12345-0@lo:104: 00010000:00010000:2.0:1787864647.399628:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399673:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864647.399679:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844771200:12345-0@lo:104: Request processed in 63us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.399685:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864647.399720:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864647.399726:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844771328:12345-0@lo:104: 00010000:00010000:2.0:1787864647.399733:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399776:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864647.399781:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844771328:12345-0@lo:104: Request processed in 56us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.399787:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787864647.399810:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864647.399816:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399822:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864647.399825:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399833:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864647.399839:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864647.399844:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864647.399870:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399876:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864647.399914:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399922:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc42f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f9b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399932:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864647.399935:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399940:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864647.399943:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399956:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864647.399962:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864647.399967:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864647.399980:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.399985:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864647.400000:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400006:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc42f78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42f7f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400016:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864647.400018:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864647.400019:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864647.400025:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864647.400042:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844771456:0@lo:103: 00000100:00100000:2.0:1787864647.400083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.400283:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844771584:0@lo:103: 00000100:00100000:2.0:1787864647.400309:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864647.400342:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771456 00000100:00100000:2.0:1787864647.400347:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771456 00010000:00010000:2.0:1787864647.400363:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 16 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.400396:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771584 00000100:00100000:2.0:1787864647.400399:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771584 00010000:00010000:2.0:1787864647.400411:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 17 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.400422:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864647.400428:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3640:x1874711844771456:12345-0@lo:103: 00010000:00010000:2.0:1787864647.400436:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864647.400440:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400449:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 17 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400462:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864647.400491:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3640:x1874711844771456:12345-0@lo:103: Request processed in 63us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.400496:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864647.400508:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864647.400514:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3637:x1874711844771584:12345-0@lo:103: 00010000:00010000:2.0:1787864647.400521:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864647.400525:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 16 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400533:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 16 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400544:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400558:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864647.400571:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006644407s 00010000:00010000:2.0:1787864647.400575:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400581:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400588:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400605:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400610:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864647.400614:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400621:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400629:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400639:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864647.400667:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3637:x1874711844771584:12345-0@lo:103: Request processed in 153us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864647.400673:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864647.400715:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844771584:0@lo:103: 00000100:00100000:2.0:1787864647.400737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844771456:0@lo:103: 00010000:00010000:2.0:1787864647.400820:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031400/0x2fcb8c294dc42f9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f94 expref: 15 pid: 6503 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.400832:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844771200:0@lo:104: 00010000:00010000:2.0:1787864647.400845:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031200/0x2fcb8c294dc42f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42f78 expref: 14 pid: 6505 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864647.400852:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844771328:0@lo:104: 00010000:00010000:2.0:1787864647.400866:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400874:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400880:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864647.400885:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43089 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864647.401040:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8417:1874711844771072:0@lo:253: 10000000:01000000:3.0:1787864647.401051:0:8417:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787864647.401054:0:8417:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864647.401056:0:8417:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864647.401203:0:8417:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864647.401205:0:8417:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864647.401206:0:8417:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864647.401208:0:8417:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864647.401209:0:8417:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864647.401211:0:8417:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864647.401212:0:8417:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864647.401215:0:8417:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864647.401217:0:8417:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787864647.401230:0:8417:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787864647.406307:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1787864647.406483:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1787864647.406706:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1787864647.409472:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1787864647.410199:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1787864647.410478:0:8417:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1787864647.411559:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787864647.419830:0:8417:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787864647.419839:0:8417:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787864647.419872:0:8417:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787864647.420022:0:8417:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787864647.420043:0:8417:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787864647.420202:0:8417:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787864647.421005:0:8417:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864647.421287:0:8417:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1787864647.961069:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844771712:0@lo:41: 00000100:00100000:2.0:1787864647.961151:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864647.961358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771712 00000100:00100000:0.0:1787864647.961366:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771712 00000100:00100000:0.0:1787864647.961417:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787864647.961427:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844771712:12345-0@lo:41: 00000004:00000024:0.0:1787864647.961458:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787864647.961515:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844771712:12345-0@lo:41: Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864647.961522:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864647.961605:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844771712:0@lo:41: 00010000:00010000:2.0:1787864648.025458:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787864648.195756:0:8502:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864648.196157:0:8502:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864649.051107:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864649.498409:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864649.498439:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844771840:0@lo:41: 00000100:00100000:3.0:1787864649.498515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864649.498613:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771840 00000100:00100000:1.0:1787864649.498621:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771840 00000100:00100000:1.0:1787864649.498669:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864649.498678:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844771840:12345-0@lo:41: 00000004:00000024:1.0:1787864649.498709:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787864649.498761:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844771840:12345-0@lo:41: Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864649.498768:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864649.498809:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844771840:0@lo:41: 00010000:00010000:0.0:1787864650.073058:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864651.102102:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864652.121402:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864652.569222:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844772096:0@lo:400: 00000100:00100000:2.0:1787864652.569292:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864652.569346:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844772608:0@lo:400: 00000100:00100000:2.0:1787864652.569370:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864652.569396:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787864652.569402:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844772224:0@lo:400: 00000100:00100000:2.0:1787864652.569425:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864652.569446:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844772736:0@lo:400: 00000100:00100000:2.0:1787864652.569468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864652.569497:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772096 00000100:00100000:2.0:1787864652.569503:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772096 00000100:00100000:2.0:1787864652.569539:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772608 00000100:00100000:2.0:1787864652.569542:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772608 00000100:00100000:2.0:1787864652.569572:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772736 00000100:00100000:2.0:1787864652.569575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772736 00000100:00100000:2.0:1787864652.569595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864652.569603:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844772096:12345-0@lo:400: 00000100:00100000:2.0:1787864652.569650:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844772096:12345-0@lo:400: Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864652.569658:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864652.569673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864652.569680:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844772608:12345-0@lo:400: 00000100:00100000:2.0:1787864652.569706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844772608:12345-0@lo:400: Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864652.569711:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864652.569722:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864652.569728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844772736:12345-0@lo:400: 00000100:00100000:2.0:1787864652.569752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844772736:12345-0@lo:400: Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864652.569764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864652.569782:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772224 00000100:00100000:2.0:1787864652.569785:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772224 00000100:00100000:2.0:1787864652.569808:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864652.569813:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844772224:12345-0@lo:400: 00000100:00100000:2.0:1787864652.569845:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844772224:12345-0@lo:400: Request processed in 31us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864652.569851:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787864652.569905:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844772224:0@lo:400: 00010000:00080000:2.0:1787864652.569920:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab92c0 x1874711844772736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864652.569930:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844772736:0@lo:400: 00010000:00080000:2.0:1787864652.569938:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab83c0 x1874711844772096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864652.569945:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844772096:0@lo:400: 00010000:00080000:2.0:1787864652.569953:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558abb840 x1874711844772608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864652.569961:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844772608:0@lo:400: 00000100:00100000:3.0:1787864652.570045:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844771968:0@lo:400: 00000100:00100000:3.0:1787864652.570084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864652.570119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844772480:0@lo:400: 00000100:00100000:3.0:1787864652.570141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864652.570162:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864652.570167:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844772352:0@lo:400: 00000100:00100000:3.0:1787864652.570189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864652.570214:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772352 00000100:00100000:3.0:1787864652.570218:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772352 00000100:00100000:3.0:1787864652.570242:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864652.570247:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844772352:12345-0@lo:400: 00000100:00100000:3.0:1787864652.570283:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844772352:12345-0@lo:400: Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864652.570287:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864652.570304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772480 00000100:00100000:3.0:1787864652.570307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772480 00000100:00100000:3.0:1787864652.570326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864652.570331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844772480:12345-0@lo:400: 00000100:00100000:3.0:1787864652.570358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844772480:12345-0@lo:400: Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864652.570364:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787864652.570389:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab8b40 x1874711844772352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864652.570397:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844772352:0@lo:400: 00000100:00100000:3.0:1787864652.570406:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844772480:0@lo:400: 00000100:00100000:2.0:1787864652.570496:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844771968 00000100:00100000:2.0:1787864652.570500:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844771968 00000100:00100000:2.0:1787864652.570531:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864652.570538:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3640:x1874711844771968:12345-0@lo:400: 00000100:00100000:2.0:1787864652.570585:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:3640:x1874711844771968:12345-0@lo:400: Request processed in 47us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864652.570602:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787864652.570684:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844771968:0@lo:400: 00000100:00080000:0.0:1787864652.570768:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864652.570773:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787864652.879648:0:8792:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787864653.082034:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787864653.082047:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927547df8000 from 30 10000000:01000000:2.0:1787864653.082054:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864653.082123:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082136:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082149:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.082179:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844772864:0@lo:101: 00000100:00100000:2.0:1787864653.082284:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.082340:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.082366:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772864 00000100:00100000:2.0:1787864653.082373:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772864 00000100:00100000:2.0:1787864653.082426:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787864653.082436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:6508:x1874711844772864:12345-0@lo:101: 00010000:00010000:2.0:1787864653.082453:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864653.082468:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43090 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082496:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082509:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082531:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796e00, rc 0) 00000100:00100000:2.0:1787864653.082586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844772864:12345-0@lo:101: Request processed in 151us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.082593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787864653.082651:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844772864:0@lo:101: 00010000:00010000:2.0:1787864653.082668:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.082679:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.082770:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844772992:0@lo:501: 00000100:00100000:2.0:1787864653.082800:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.082818:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.082833:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844772992 00000100:00100000:2.0:1787864653.082836:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844772992 00000100:00100000:2.0:1787864653.082856:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864653.082863:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844772992:12345-0@lo:501: 00000100:00100000:2.0:1787864653.083028:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844772992:12345-0@lo:501: Request processed in 165us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.083036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864653.083064:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844772992:0@lo:501: 00000100:00100000:2.0:1787864653.083093:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773120:0@lo:503: 00000100:00100000:2.0:1787864653.083138:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.083149:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.083166:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773120 00000100:00100000:2.0:1787864653.083169:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773120 00000100:00100000:2.0:1787864653.083188:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787864653.083194:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844773120:12345-0@lo:503: 00000100:00100000:2.0:1787864653.083282:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844773120:12345-0@lo:503: Request processed in 88us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.083290:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787864653.083338:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773120:0@lo:503: 00000100:00100000:2.0:1787864653.083602:0:8807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8807:1874711844773248:0@lo:502: 00000100:00100000:2.0:1787864653.083642:0:8807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.083663:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773248 00000100:00100000:2.0:1787864653.083667:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773248 00000100:00100000:2.0:1787864653.083691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864653.083696:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8807:x1874711844773248:12345-0@lo:502: 00000100:00100000:2.0:1787864653.083777:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8807:x1874711844773248:12345-0@lo:502: Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.083784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864653.083828:0:8807:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.083840:0:8807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8807:1874711844773248:0@lo:502: 00000100:00100000:2.0:1787864653.083876:0:8807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8807:1874711844773376:0@lo:502: 00000100:00100000:2.0:1787864653.083922:0:8807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.083941:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773376 00000100:00100000:2.0:1787864653.083944:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773376 00000100:00100000:2.0:1787864653.083965:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864653.083970:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8807:x1874711844773376:12345-0@lo:502: 00000100:00100000:2.0:1787864653.084022:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:8807:x1874711844773376:12345-0@lo:502: Request processed in 51us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.084034:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864653.084059:0:8807:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.084070:0:8807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8807:1874711844773376:0@lo:502: 00000040:00080000:2.0:1787864653.084088:0:8807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787864653.084148:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787864653.084169:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864653.084178:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084189:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864653.084201:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864653.084205:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927547df8000 from 5 10000000:01000000:2.0:1787864653.084208:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864653.084239:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084247:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084257:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.084269:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773504:0@lo:101: 00000100:00100000:2.0:1787864653.084296:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.084310:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.084324:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773504 00000100:00100000:2.0:1787864653.084327:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773504 00000100:00100000:2.0:1787864653.084355:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864653.084361:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844773504:12345-0@lo:101: 00010000:00010000:2.0:1787864653.084370:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864653.084384:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4309e expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084403:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084414:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084424:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796a00, rc 0) 00000100:00100000:2.0:1787864653.084451:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844773504:12345-0@lo:101: Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.084457:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864653.084486:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773504:0@lo:101: 00010000:00010000:2.0:1787864653.084498:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.084507:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.084547:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773632:0@lo:256: 00000100:00100000:2.0:1787864653.084588:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.084600:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.084610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773632 00000100:00100000:2.0:1787864653.084613:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773632 00000100:00100000:2.0:1787864653.084630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787864653.084644:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844773632:12345-0@lo:256: 20000000:01000000:2.0:1787864653.084658:0:6505:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787864653.084678:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787864653.084681:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787864653.086413:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844773760:0@lo:41: 00000100:00100000:0.0:1787864653.086510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.086603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773760 00000100:00100000:0.0:1787864653.086612:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773760 00000100:00100000:0.0:1787864653.086674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864653.086684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844773760:12345-0@lo:41: 00000004:00000024:0.0:1787864653.086823:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787864653.086879:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844773760:12345-0@lo:41: Request processed in 196us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.086907:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864653.086964:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844773760:0@lo:41: 00000100:00100000:2.0:1787864653.090576:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844773632:12345-0@lo:256: Request processed in 5908us (5962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.090595:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787864653.090870:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773632:0@lo:256: 10000000:01000000:0.0:1787864653.091228:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864653.091241:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.091254:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864653.091266:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1787864653.091269:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1787864653.091283:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787864653.091326:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.091335:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.091345:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864653.091368:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773888:0@lo:101: 00000100:00100000:0.0:1787864653.091431:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.091471:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.095608:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844773888 00000100:00100000:2.0:1787864653.095625:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844773888 00000100:00100000:2.0:1787864653.095695:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787864653.095707:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844773888:12345-0@lo:101: 00010000:00010000:2.0:1787864653.095741:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864653.095765:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc430ac expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.095799:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.095813:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.095824:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797800, rc 0) 00000100:00100000:2.0:1787864653.095943:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844773888:12345-0@lo:101: Request processed in 237us (4511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.095951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787864653.096018:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844773888:0@lo:101: 00010000:00010000:2.0:1787864653.096039:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.096060:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.096257:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774016:0@lo:501: 00000100:00100000:2.0:1787864653.096297:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.096332:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.096348:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774016 00000100:00100000:2.0:1787864653.096352:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774016 00000100:00100000:2.0:1787864653.096383:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787864653.096391:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844774016:12345-0@lo:501: 00000100:00100000:2.0:1787864653.096530:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844774016:12345-0@lo:501: Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.096537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787864653.096580:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774016:0@lo:501: 00000100:00100000:2.0:1787864653.096610:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774144:0@lo:503: 00000100:00100000:2.0:1787864653.096663:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.096678:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.096690:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774144 00000100:00100000:2.0:1787864653.096693:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774144 00000100:00100000:2.0:1787864653.096710:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864653.096716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844774144:12345-0@lo:503: 00000100:00100000:2.0:1787864653.096857:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844774144:12345-0@lo:503: Request processed in 140us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.096865:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864653.096931:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774144:0@lo:503: 00000100:00100000:2.0:1787864653.097795:0:8808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8808:1874711844774272:0@lo:502: 00000100:00100000:2.0:1787864653.097856:0:8808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.097908:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774272 00000100:00100000:2.0:1787864653.097914:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774272 00000100:00100000:2.0:1787864653.097947:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787864653.097954:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8808:x1874711844774272:12345-0@lo:502: 00000100:00100000:2.0:1787864653.098051:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8808:x1874711844774272:12345-0@lo:502: Request processed in 96us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.098059:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787864653.098855:0:8808:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.098907:0:8808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8808:1874711844774272:0@lo:502: 00000020:01000000:2.0:1787864653.098946:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864653.098956:0:8808:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787864653.098964:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864653.098967:0:8808:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787864653.098972:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864653.098976:0:8808:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864653.099002:0:8808:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787864653.099004:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864653.099023:0:8808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff927446ff4ed8) 00000020:00000080:2.0:1787864653.099047:0:8808:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1787864653.099054:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864653.099937:0:8808:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787864653.099948:0:8808:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787864653.099959:0:8808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc430c1 00010000:00080000:2.0:1787864653.100012:0:8808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757de4c800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864653.101046:0:8808:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787864653.123525:0:8808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787864653.123571:0:8808:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787864653.124213:0:8808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864653.124439:0:8808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864653.124532:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787864653.124629:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787864653.130732:0:8810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864653.130745:0:8810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787864653.142339:0:8808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787864653.142359:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787864653.142419:0:8808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787864653.142531:0:8808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc430c8 00000100:00080000:3.0:1787864653.142546:0:8808:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864653.142553:0:8808:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff92757de4c800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864653.142607:0:8808:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757bcbd2c0 x1874711844774400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864653.144333:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844774400:0@lo:8: 00000100:00100000:1.0:1787864653.144458:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.144637:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774400 00000100:00100000:0.0:1787864653.144651:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774400 00000100:00100000:0.0:1787864653.144693:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864653.144702:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874711844774400:12345-0@lo:8: 00010000:00080000:0.0:1787864653.144733:0:8423:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1787864653.144762:0:8423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc430cf 00002000:00100000:0.0:1787864653.144804:0:8423:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff92744679f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787864653.144809:0:8423:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787864653.144812:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787864653.145006:0:8808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1787864653.146391:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787864653.146689:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864653.146698:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.146701:0:8808:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787864653.146705:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864653.146721:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.146723:0:8808:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864653.146726:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864653.146728:0:8808:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864653.146792:0:8808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8808:1874711844774528:0@lo:502: 00000100:00100000:3.0:1787864653.146924:0:8808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.146972:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774528 00000100:00100000:3.0:1787864653.146978:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774528 00000100:00100000:3.0:1787864653.147041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787864653.147050:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8808:x1874711844774528:12345-0@lo:502: 00000100:00100000:3.0:1787864653.147189:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:8808:x1874711844774528:12345-0@lo:502: Request processed in 139us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.147197:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787864653.147254:0:8808:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ecec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864653.147283:0:8808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8808:1874711844774528:0@lo:502: 00000020:01000000:3.0:1787864653.147308:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864653.147312:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.147313:0:8808:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864653.147317:0:8808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1787864653.147377:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1787864653.147404:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787864653.147416:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864653.147427:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864653.147440:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864653.147443:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927548600000 from 30 10000000:01000000:3.0:1787864653.147446:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864653.147477:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864653.147486:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864653.147496:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864653.147511:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774656:0@lo:101: 00002000:00100000:0.0:1787864653.147544:0:8423:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787864653.147556:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.147590:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc5cc0 going to sleep for 11 seconds 00002000:00080000:0.0:1787864653.147820:0:8423:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787864653.147855:0:8423:0:(import.c:65:import_set_state_nolock()) ffff92744679d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864653.147965:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844774400:12345-0@lo:8: Request processed in 3262us (3506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.147975:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864653.153825:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774656 00000100:00100000:1.0:1787864653.153843:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774656 00000100:00100000:1.0:1787864653.153946:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787864653.153958:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844774656:12345-0@lo:101: 00010000:00010000:1.0:1787864653.153977:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864653.154000:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc430d6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864653.154051:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864653.154062:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864653.154082:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949800, rc 0) 00000100:00100000:1.0:1787864653.154177:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844774656:12345-0@lo:101: Request processed in 222us (6630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.154184:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864653.154541:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774656:0@lo:101: 00010000:00010000:3.0:1787864653.154583:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864653.154608:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864653.154719:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774784:0@lo:501: 00000100:00100000:3.0:1787864653.154763:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.154800:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864653.155214:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864653.155239:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844774912:0@lo:400: 00000100:00100000:0.0:1787864653.155442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.155512:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774912 00000100:00100000:0.0:1787864653.155519:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774912 00000100:00100000:0.0:1787864653.155577:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864653.155587:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844774912:12345-0@lo:400: 00000100:00100000:0.0:1787864653.155641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844774912:12345-0@lo:400: Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.155650:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787864653.155698:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbbad00 x1874711844774912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864653.155712:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844774912:0@lo:400: 00010000:00080000:0.0:1787864653.155750:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcbd2c0 x1874711844774400/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864653.155759:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864653.155767:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787864653.155775:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787864653.155780:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787864653.155783:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757de4c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787864653.155796:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787864653.155801:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844774400:0@lo:8: 00000100:00100000:0.0:1787864653.155852:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844775296:0@lo:400: 00000100:00100000:0.0:1787864653.155882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.155931:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775296 00000100:00100000:0.0:1787864653.155935:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775296 00000100:00100000:0.0:1787864653.155970:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864653.155975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844775296:12345-0@lo:400: 00000100:00100000:0.0:1787864653.156007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844775296:12345-0@lo:400: Request processed in 32us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.156013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1787864653.156437:0:8810:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787864653.156535:0:8810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 178218645309ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787864653.156543:0:8810:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:0.0:1787864653.156722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbb83c0 x1874711844775296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864653.156735:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844775296:0@lo:400: 00000100:00100000:1.0:1787864653.156825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844775424:0@lo:400: 00000100:00100000:1.0:1787864653.156874:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.156994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775424 00000100:00100000:0.0:1787864653.157000:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775424 00000100:00100000:0.0:1787864653.157045:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864653.157053:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844775424:12345-0@lo:400: 00000100:00100000:0.0:1787864653.160570:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844775424:12345-0@lo:400: Request processed in 3502us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.160584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864653.160687:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844775552:0@lo:700: 00000100:00100000:0.0:1787864653.160737:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.160771:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775552 00000100:00100000:0.0:1787864653.160777:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775552 00000100:00100000:0.0:1787864653.160819:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864653.160827:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8812:x1874711844775552:12345-0@lo:700: 00000100:00100000:0.0:1787864653.160859:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1874711844775680:0@lo:700: 00000100:00100000:0.0:1787864653.160886:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.160923:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03d80 going to sleep for 11 seconds 00000100:00080000:0.0:1787864653.160937:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864653.160951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775680 00000100:00100000:0.0:1787864653.160966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775680 00000100:00100000:0.0:1787864653.160996:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864653.161002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1874711844775680:12345-0@lo:700: 00000100:00100000:0.0:1787864653.161172:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03480 going to sleep for 11 seconds 00010000:00080000:1.0:1787864653.161295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbb83c0 x1874711844775424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864653.161311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844775424:0@lo:400: 00000100:00100000:3.0:1787864653.162123:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844775040:0@lo:400: 00000100:00100000:3.0:1787864653.162211:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.162263:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864653.162274:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844775168:0@lo:400: 00000100:00100000:3.0:1787864653.162305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.162345:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844774784 00000100:00100000:3.0:1787864653.162353:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844774784 00000100:00100000:3.0:1787864653.162401:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787864653.162411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844774784:12345-0@lo:501: 00000100:00100000:3.0:1787864653.162602:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844774784:12345-0@lo:501: Request processed in 191us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.162611:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787864653.162661:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775040 00000100:00100000:3.0:1787864653.162667:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775040 00000100:00100000:3.0:1787864653.162707:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787864653.162715:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844775040:12345-0@lo:400: 00000100:00100000:3.0:1787864653.162779:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844775040:12345-0@lo:400: Request processed in 65us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.162786:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787864653.162808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775168 00000100:00100000:3.0:1787864653.162825:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775168 00000100:00100000:3.0:1787864653.162855:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864653.162862:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844775168:12345-0@lo:400: 00000100:00100000:3.0:1787864653.162921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844775168:12345-0@lo:400: Request processed in 59us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.162927:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864653.162967:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844774784:0@lo:501: 00000100:00100000:3.0:1787864653.163022:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844775808:0@lo:503: 00000100:00100000:3.0:1787864653.163068:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.163098:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864653.163122:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775808 00000100:00100000:3.0:1787864653.163125:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775808 00000100:00100000:3.0:1787864653.163149:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864653.163155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844775808:12345-0@lo:503: 00000100:00100000:3.0:1787864653.163259:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844775808:12345-0@lo:503: Request processed in 103us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.163266:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864653.163308:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844775808:0@lo:503: 00010000:00080000:3.0:1787864653.163366:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbba940 x1874711844775168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864653.163378:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844775168:0@lo:400: 00000100:00100000:3.0:1787864653.163391:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844775040:0@lo:400: 00000004:00080000:0.0:1787864653.166953:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787864653.169053:0:8815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8815:1874711844775936:0@lo:502: 00000100:00100000:0.0:1787864653.169128:0:8815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.169164:0:8815:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03900 going to sleep for 11 seconds 00000100:00100000:3.0:1787864653.170610:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844775936 00000100:00100000:3.0:1787864653.170628:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844775936 00000100:00100000:3.0:1787864653.170711:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864653.170739:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8815:x1874711844775936:12345-0@lo:502: 00000100:00100000:3.0:1787864653.171013:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8815:x1874711844775936:12345-0@lo:502: Request processed in 276us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.171021:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787864653.171463:0:8815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8815:1874711844775936:0@lo:502: 00000100:00100000:0.0:1787864653.171552:0:8815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8815:1874711844776064:0@lo:502: 00000100:00100000:0.0:1787864653.171632:0:8815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.171667:0:8815:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864653.171813:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776064 00000100:00100000:1.0:1787864653.171825:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776064 00000100:00100000:1.0:1787864653.171876:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787864653.171886:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8815:x1874711844776064:12345-0@lo:502: 40000000:02000000:2.0:1787864653.172408:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1787864653.173113:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:8815:x1874711844776064:12345-0@lo:502: Request processed in 1226us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.173124:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787864653.173194:0:8815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8815:1874711844776064:0@lo:502: 00000040:00080000:1.0:1787864653.173233:0:8815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:2.0:1787864653.181532:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8432:x1874711844775680:12345-0@lo:700: Request processed in 20522us (20636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.181550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:2.0:1787864653.181601:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787864653.181627:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864653.181636:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787864653.181638:0:8432:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbbbc00 x1874711844775680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787864653.181648:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864653.181652:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8432:1874711844775680:0@lo:700: 10000000:01000000:2.0:1787864653.181657:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864653.181659:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927548600000 from 5 10000000:01000000:2.0:1787864653.181662:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 40000000:02000000:0.0:1787864653.181664:0:8432:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00010000:00010000:2.0:1787864653.181691:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.181698:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.181706:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.181723:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776192:0@lo:101: 00000100:00100000:2.0:1787864653.181762:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.181817:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.181835:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776192 00000100:00100000:2.0:1787864653.181840:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776192 00000100:00100000:2.0:1787864653.181877:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787864653.181885:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844776192:12345-0@lo:101: 00010000:00010000:2.0:1787864653.181923:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864653.181935:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc430e4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.181956:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.181967:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.181988:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796200, rc 0) 00000100:00100000:2.0:1787864653.182019:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844776192:12345-0@lo:101: Request processed in 134us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.182025:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787864653.182060:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776192:0@lo:101: 00010000:00010000:2.0:1787864653.182071:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182080:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.182126:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776320:0@lo:256: 00000100:00100000:2.0:1787864653.182155:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.182175:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.182192:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776320 00000100:00100000:2.0:1787864653.182196:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776320 00000100:00100000:2.0:1787864653.182220:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787864653.182226:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844776320:12345-0@lo:256: 20000000:01000000:2.0:1787864653.182238:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787864653.182253:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787864653.182256:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787864653.182328:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844776320:12345-0@lo:256: Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.182335:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787864653.182363:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776320:0@lo:256: 10000000:01000000:2.0:1787864653.182416:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864653.182422:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182430:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864653.182437:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787864653.182439:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787864653.182442:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787864653.182457:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182464:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182472:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.182508:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776448:0@lo:101: 00000100:00100000:2.0:1787864653.182531:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.182545:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.182633:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776448 00000100:00100000:2.0:1787864653.182637:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776448 00000100:00100000:2.0:1787864653.182661:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787864653.182667:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844776448:12345-0@lo:101: 00010000:00010000:2.0:1787864653.182674:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864653.182682:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc430f2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182695:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182703:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182710:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796000, rc 0) 00000100:00100000:2.0:1787864653.182740:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844776448:12345-0@lo:101: Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.182746:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787864653.182775:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776448:0@lo:101: 00010000:00010000:2.0:1787864653.182785:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864653.182792:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864653.182849:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776576:0@lo:501: 00000100:00100000:2.0:1787864653.182873:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.182886:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.182918:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776576 00000100:00100000:2.0:1787864653.182921:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776576 00000100:00100000:2.0:1787864653.182942:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864653.182948:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844776576:12345-0@lo:501: 00000100:00100000:2.0:1787864653.183053:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844776576:12345-0@lo:501: Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.183060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864653.183089:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776576:0@lo:501: 00000100:00100000:2.0:1787864653.183113:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776704:0@lo:503: 00000100:00100000:2.0:1787864653.183147:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.183166:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.183176:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776704 00000100:00100000:2.0:1787864653.183179:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776704 00000100:00100000:2.0:1787864653.183199:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787864653.183204:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844776704:12345-0@lo:503: 00000100:00100000:2.0:1787864653.183271:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844776704:12345-0@lo:503: Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.183277:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787864653.183312:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844776704:0@lo:503: 00000100:00100000:2.0:1787864653.184555:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8816:1874711844776832:0@lo:502: 00000100:00100000:2.0:1787864653.184619:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.184690:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864653.184954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776832 00000100:00100000:3.0:1787864653.184960:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776832 00000100:00100000:3.0:1787864653.185100:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787864653.185109:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:8816:x1874711844776832:12345-0@lo:502: 00000100:00100000:3.0:1787864653.185217:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:8816:x1874711844776832:12345-0@lo:502: Request processed in 109us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864653.185224:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787864653.185293:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8816:1874711844776832:0@lo:502: 00000020:01000000:2.0:1787864653.185320:0:8816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864653.185327:0:8816:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787864653.185334:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864653.185336:0:8816:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787864653.185343:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864653.185346:0:8816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864653.185369:0:8816:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787864653.185372:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864653.185386:0:8816:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff927446ff3490) 00000020:00000080:2.0:1787864653.185407:0:8816:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1787864653.185413:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864653.185500:0:8816:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787864653.185505:0:8816:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787864653.185512:0:8816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc43107 00010000:00080000:2.0:1787864653.185539:0:8816:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757fa92000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864653.185755:0:8816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1787864653.194083:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1787864653.194205:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844775552:12345-0@lo:700: Request processed in 33373us (33463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.194219:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787864653.194270:0:8812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbbb480 x1874711844775552/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864653.194287:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844775552:0@lo:700: 00000040:01000000:1.0:1787864653.196790:0:8816:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787864653.196812:0:8816:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787864653.197128:0:8816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864653.197318:0:8816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864653.197677:0:8816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787864653.197769:0:8816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787864653.198916:0:8818:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864653.198922:0:8818:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787864653.200242:0:8816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787864653.200258:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787864653.200305:0:8816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787864653.200330:0:8816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc4310e 00000100:00080000:3.0:1787864653.200342:0:8816:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864653.200348:0:8816:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92757fa92000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864653.200382:0:8816:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558998b40 x1874711844776960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864653.200411:0:8816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787864653.200484:0:8816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864653.200489:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.200491:0:8816:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787864653.200494:0:8816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864653.200498:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.200500:0:8816:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864653.200502:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864653.200504:0:8816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864653.200538:0:8816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8816:1874711844777088:0@lo:502: 00000100:00100000:0.0:1787864653.200774:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844776960:0@lo:8: 00000100:00100000:0.0:1787864653.200813:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.200875:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844776960 00000100:00100000:0.0:1787864653.200881:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844776960 00000100:00100000:0.0:1787864653.200930:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864653.200937:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1874711844776960:12345-0@lo:8: 00010000:00080000:0.0:1787864653.200958:0:8426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:0.0:1787864653.200981:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc43115 00002000:00100000:0.0:1787864653.200994:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff927446799000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787864653.200997:0:8426:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787864653.201000:0:8426:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787864653.201067:0:8816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.201098:0:8816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757651d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.201148:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777088 00000100:00100000:2.0:1787864653.201152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777088 00002000:00080000:0.0:1787864653.201186:0:8426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864653.201209:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92744679c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864653.201218:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787864653.201225:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:8816:x1874711844777088:12345-0@lo:502: 00000100:00100000:0.0:1787864653.201300:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844776960:12345-0@lo:8: Request processed in 361us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.201307:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864653.201330:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:8816:x1874711844777088:12345-0@lo:502: Request processed in 106us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.201337:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864653.201425:0:8816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:8816:1874711844777088:0@lo:502: 00000020:01000000:3.0:1787864653.201451:0:8816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864653.201457:0:8816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864653.201458:0:8816:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864653.201462:0:8816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:1.0:1787864653.202223:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558998b40 x1874711844776960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864653.202235:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864653.202243:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787864653.202252:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787864653.202257:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787864653.202260:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757fa92000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787864653.202278:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787864653.202283:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844776960:0@lo:8: 00000004:00080000:1.0:1787864653.202314:0:8818:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787864653.202375:0:8818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178264485891ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787864653.202382:0:8818:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1787864653.203846:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787864653.203878:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787864653.203900:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.203912:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864653.203922:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787864653.203925:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92755ed9ced8 from 1 10000000:01000000:0.0:1787864653.203928:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787864653.203963:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.203971:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.203989:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864653.204012:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844777216:0@lo:101: 00000100:00100000:0.0:1787864653.204093:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.204125:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03480 going to sleep for 11 seconds 00000100:00100000:0.0:1787864653.204144:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777216 00000100:00100000:0.0:1787864653.204149:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777216 00000100:00100000:0.0:1787864653.204193:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787864653.204202:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844777216:12345-0@lo:101: 00010000:00010000:0.0:1787864653.204215:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864653.204227:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4311c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.204248:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.204258:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864653.204267:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:0.0:1787864653.204308:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844777216:12345-0@lo:101: Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.204315:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864653.205041:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844777216:0@lo:101: 00010000:00010000:1.0:1787864653.205058:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864653.205070:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864653.205572:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844777344:0@lo:501: 00000100:00100000:1.0:1787864653.205820:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864653.205859:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927545668540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864653.206693:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777344 00000100:00100000:2.0:1787864653.206701:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777344 00000100:00100000:2.0:1787864653.206753:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787864653.206772:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844777344:12345-0@lo:501: 00000100:00100000:2.0:1787864653.206911:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844777344:12345-0@lo:501: Request processed in 127us (1273us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864653.206920:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787864653.207439:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844777344:0@lo:501: 10000000:01000000:1.0:1787864653.207485:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787864653.207493:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864653.207505:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787864653.207910:0:8812:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787864653.207932:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844777600:0@lo:7: 00000100:00100000:0.0:1787864653.207964:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864653.207978:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.207981:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844777472:0@lo:13: 00000100:00100000:1.0:1787864653.208003:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff927545668540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864653.208032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864653.208077:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777600 00000100:00100000:0.0:1787864653.208082:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777600 00000100:00100000:0.0:1787864653.208112:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864653.208119:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844777600:12345-0@lo:7: 00000100:00100000:1.0:1787864653.208375:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777472 00000100:00100000:1.0:1787864653.208380:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777472 00000100:00100000:1.0:1787864653.208405:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864653.208412:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844777472:12345-0@lo:13: 00002000:00000024:1.0:1787864653.208502:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:1.0:1787864653.208909:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844777472:12345-0@lo:13: Request processed in 477us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.208918:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787864653.208966:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc4780 x1874711844777472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.208997:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844777472:0@lo:13: 00000004:00080000:3.0:1787864653.213761:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787864653.213845:0:8819:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787864653.213869:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844777856:0@lo:7: 00000100:00100000:3.0:1787864653.213956:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.214000:0:8423:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787864653.214007:0:8423:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1787864653.215328:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787864653.215336:0:8425:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787864653.215406:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844777600:12345-0@lo:7: Request processed in 7285us (7427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.215416:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864653.215438:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777856 00000100:00100000:0.0:1787864653.215444:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777856 00000100:00080000:0.0:1787864653.215469:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864653.215498:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864653.215506:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8819:x1874711844777856:12345-0@lo:7: 00000100:00100000:2.0:1787864653.216513:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864653.216532:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844777728:0@lo:13: 00000100:00100000:2.0:1787864653.216594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.216646:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777728 00000100:00100000:2.0:1787864653.216651:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777728 00000100:00100000:2.0:1787864653.216685:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864653.216692:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844777728:12345-0@lo:13: 00002000:00000024:2.0:1787864653.216709:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923943424 avail 3692421120 00000100:00100000:2.0:1787864653.216747:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844777728:12345-0@lo:13: Request processed in 55us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864653.216754:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787864653.216805:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558999a40 x1874711844777728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.216824:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844777728:0@lo:13: 00000100:00100000:2.0:1787864653.217006:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568edf180 going to sleep for 11 seconds 00010000:00080000:1.0:1787864653.217333:0:8812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc61c0 x1874711844777600/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864653.217344:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844777600:0@lo:7: 00000004:00080000:1.0:1787864653.217353:0:8812:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787864653.217380:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844777984:0@lo:5: 00000100:00100000:1.0:1787864653.217409:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864653.217423:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff927545668540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864653.218285:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787864653.218294:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844777984 00000100:00100000:1.0:1787864653.218298:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844777984 00000100:00100000:1.0:1787864653.218525:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864653.218534:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844777984:12345-0@lo:5: 00002000:00080000:1.0:1787864653.218556:0:8820:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1787864653.218629:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844777984:12345-0@lo:5: Request processed in 97us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.218636:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787864653.219301:0:8812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc61c0 x1874711844777984/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864653.219315:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844777984:0@lo:5: 00000004:00080000:3.0:1787864653.219326:0:8812:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787864653.219359:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844778112:0@lo:5: 00000100:00100000:3.0:1787864653.219393:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864653.219424:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568edf240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864653.219468:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778112 00000100:00100000:1.0:1787864653.219486:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778112 00000100:00100000:1.0:1787864653.219521:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864653.219528:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8812:x1874711844778112:12345-0@lo:5: 00002000:00080000:1.0:1787864653.219551:0:8426:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787864653.224274:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8812:x1874711844778112:12345-0@lo:5: Request processed in 4741us (4875us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787864653.224287:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787864653.225093:0:8812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558998780 x1874711844778112/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.225112:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8812:1874711844778112:0@lo:5: 00000004:00080000:2.0:1787864653.225127:0:8812:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787864653.225178:0:8812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8812:1874711844778240:0@lo:900: 00000100:00100000:2.0:1787864653.225221:0:8812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.225257:0:8812:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864653.225313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778240 00000100:00100000:1.0:1787864653.225318:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778240 00000100:00100000:1.0:1787864653.225359:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864653.225367:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8812:x1874711844778240:12345-0@lo:900: 00000100:00100000:1.0:1787864653.225412:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8812:x1874711844778240:12345-0@lo:900: Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.225420:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787864653.225544:0:8812:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab8b40 x1874711844778240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.225554:0:8812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8812:1874711844778240:0@lo:900: 00002000:00080000:1.0:1787864653.227432:0:8425:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787864653.227439:0:8425:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787864653.227528:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8819:x1874711844777856:12345-0@lo:7: Request processed in 12021us (13571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864653.227539:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787864653.228065:0:8819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558999e00 x1874711844777856/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.228079:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844777856:0@lo:7: 00000004:00080000:2.0:1787864653.228091:0:8819:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787864653.228125:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778368:0@lo:5: 00000100:00100000:2.0:1787864653.228158:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.228179:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864653.228239:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778368 00000100:00100000:1.0:1787864653.228244:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778368 00000100:00100000:1.0:1787864653.228280:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864653.228287:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8819:x1874711844778368:12345-0@lo:5: 00002000:00080000:1.0:1787864653.228309:0:8820:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787864653.228312:0:8820:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1787864653.237959:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1787864653.237974:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787864653.237981:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787864653.238170:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8819:x1874711844778368:12345-0@lo:5: Request processed in 9878us (10008us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787864653.238182:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787864653.238287:0:8819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab8b40 x1874711844778368/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.238299:0:8819:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787864653.238305:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778368:0@lo:5: 00000004:00080000:2.0:1787864653.238318:0:8819:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787864653.238359:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778496:0@lo:700: 00000100:00100000:2.0:1787864653.238391:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.238459:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864653.238574:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778496 00000100:00100000:0.0:1787864653.238580:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778496 00000100:00100000:0.0:1787864653.238615:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864653.238624:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8819:x1874711844778496:12345-0@lo:700: 00000100:00100000:0.0:1787864653.248167:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8819:x1874711844778496:12345-0@lo:700: Request processed in 9534us (9765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864653.248181:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787864653.248318:0:8819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab8b40 x1874711844778496/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.248334:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778496:0@lo:700: 00000004:02000040:3.0:1787864653.251016:0:8819:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1787864653.257187:0:8819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778624:0@lo:5: 00000100:00100000:2.0:1787864653.257251:0:8819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864653.257307:0:8819:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864653.257431:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778624 00000100:00100000:0.0:1787864653.257439:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778624 00000100:00100000:0.0:1787864653.257495:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864653.257503:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8819:x1874711844778624:12345-0@lo:5: 00002000:00080000:0.0:1787864653.266152:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1787864653.266174:0:8426:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1787864653.268607:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8819:x1874711844778624:12345-0@lo:5: Request processed in 11099us (11350us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787864653.268620:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787864653.268785:0:8819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558ab8b40 x1874711844778624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864653.268801:0:8819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8819:1874711844778624:0@lo:5: 00000004:00080000:2.0:1787864653.268812:0:8819:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:2.0:1787864653.740796:0:8853:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864653.741270:0:8853:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864654.170519:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864654.620711:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844778752:0@lo:41: 00000100:00100000:0.0:1787864654.620805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864654.622013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778752 00000100:00100000:1.0:1787864654.622026:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778752 00000100:00100000:1.0:1787864654.622094:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864654.622104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844778752:12345-0@lo:41: 00000004:00000024:1.0:1787864654.622152:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1787864654.624023:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844778752:12345-0@lo:41: Request processed in 1908us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864654.624039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864654.626160:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844778752:0@lo:41: 00000001:00080000:2.0:1787864654.643184:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1787864655.193821:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864656.219244:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787864656.436270:0:8954:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864656.436480:0:8954:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1787864657.153846:0:9002:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864657.153857:0:9002:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787864657.243882:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864658.206162:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844778880:0@lo:41: 00000100:00100000:2.0:1787864658.206237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.206319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844778880 00000100:00100000:2.0:1787864658.206326:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844778880 00000100:00100000:2.0:1787864658.206383:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864658.206392:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844778880:12345-0@lo:41: 00000004:00000024:2.0:1787864658.206423:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787864658.206473:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844778880:12345-0@lo:41: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864658.206479:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864658.206526:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844778880:0@lo:41: 00010000:00010000:0.0:1787864658.269144:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864658.713034:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864658.713057:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844779136:0@lo:13: 00000100:00100000:2.0:1787864658.713121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713194:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844779008:0@lo:13: 00000100:00100000:2.0:1787864658.713220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864658.713256:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779136 00000100:00100000:0.0:1787864658.713264:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779136 00000100:00100000:0.0:1787864658.713310:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779008 00000100:00100000:0.0:1787864658.713313:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779008 00000100:00100000:0.0:1787864658.713331:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864658.713340:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844779136:12345-0@lo:13: 00002000:00000024:0.0:1787864658.713367:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864658.713432:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844779136:12345-0@lo:13: Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864658.713444:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864658.713460:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864658.713467:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844779008:12345-0@lo:13: 00002000:00000024:0.0:1787864658.713477:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864658.713498:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844779008:12345-0@lo:13: Request processed in 32us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864658.713504:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787864658.713543:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864658.713553:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558999e00 x1874711844779136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864658.713564:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787864658.713596:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844779136:0@lo:13: 00010000:00080000:3.0:1787864658.713617:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dcce940 x1874711844779008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864658.713624:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1787864658.713637:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844779008:0@lo:13: 00000100:00100000:2.0:1787864658.713744:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844779264:0@lo:400: 00000100:00100000:1.0:1787864658.713775:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844779520:0@lo:400: 00000100:00100000:2.0:1787864658.713784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713818:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844779776:0@lo:400: 00000100:00100000:1.0:1787864658.713822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713871:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787864658.713877:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844779392:0@lo:400: 00000100:00100000:2.0:1787864658.713925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713944:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844779904:0@lo:400: 00000100:00100000:2.0:1787864658.713963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864658.713988:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779776 00000100:00100000:2.0:1787864658.713993:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779776 00000100:00100000:0.0:1787864658.714009:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779264 00000100:00100000:0.0:1787864658.714015:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779264 00000100:00100000:2.0:1787864658.714045:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779392 00000100:00100000:2.0:1787864658.714050:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779392 00000100:00100000:0.0:1787864658.714054:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787864658.714064:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3639:x1874711844779264:12345-0@lo:400: 00000100:00100000:2.0:1787864658.714072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779904 00000100:00100000:1.0:1787864658.714074:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864658.714077:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779904 00000100:00100000:1.0:1787864658.714085:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844779648:0@lo:400: 00000100:00100000:2.0:1787864658.714102:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787864658.714113:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3639:x1874711844779264:12345-0@lo:400: Request processed in 50us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864658.714114:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844779776:12345-0@lo:400: 00000100:00100000:1.0:1787864658.714125:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864658.714130:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787864658.714155:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779520 00000100:00100000:1.0:1787864658.714161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779520 00000100:00100000:2.0:1787864658.714168:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844779776:12345-0@lo:400: Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864658.714177:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864658.714192:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844779648 00000100:00100000:2.0:1787864658.714196:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844779648 00000100:00100000:1.0:1787864658.714203:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864658.714214:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844779520:12345-0@lo:400: 00000100:00100000:2.0:1787864658.714219:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787864658.714229:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844779392:12345-0@lo:400: 00000100:00100000:1.0:1787864658.714265:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844779520:12345-0@lo:400: Request processed in 54us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864658.714274:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844779392:12345-0@lo:400: Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864658.714275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864658.714289:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787864658.714307:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844779520:0@lo:400: 00000100:00100000:3.0:1787864658.714394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864658.714403:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844779904:12345-0@lo:400: 00000100:00100000:3.0:1787864658.714439:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844779904:12345-0@lo:400: Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864658.714445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864658.714470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787864658.714476:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844779648:12345-0@lo:400: 00000100:00100000:3.0:1787864658.714517:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844779648:12345-0@lo:400: Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864658.714522:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787864658.715069:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dcce1c0 x1874711844779648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864658.715080:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844779648:0@lo:400: 00000100:00080000:2.0:1787864658.715163:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864658.715167:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787864658.715185:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccf840 x1874711844779392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864658.715194:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844779392:0@lo:400: 00010000:00080000:2.0:1787864658.715204:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccf0c0 x1874711844779904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864658.715209:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844779904:0@lo:400: 00000100:00100000:2.0:1787864658.715308:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844779264:0@lo:400: 00010000:00080000:2.0:1787864658.715323:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccde00 x1874711844779776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864658.715331:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844779776:0@lo:400: 00010000:00010000:0.0:1787864659.294704:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864659.738190:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864659.738214:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844780032:0@lo:41: 00000100:00100000:0.0:1787864659.738278:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864659.738369:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780032 00000100:00100000:3.0:1787864659.738376:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780032 00000100:00100000:3.0:1787864659.738422:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864659.738431:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844780032:12345-0@lo:41: 00000004:00000024:3.0:1787864659.738464:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787864659.738514:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844780032:12345-0@lo:41: Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864659.738521:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864659.738606:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844780032:0@lo:41: 00010000:00010000:0.0:1787864660.313475:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864661.340119:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864662.367131:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864663.327165:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844780160:0@lo:41: 00000100:00100000:3.0:1787864663.327244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864663.327687:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780160 00000100:00100000:1.0:1787864663.327695:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780160 00000100:00100000:1.0:1787864663.327749:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787864663.327760:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844780160:12345-0@lo:41: 00000004:00000024:1.0:1787864663.327793:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787864663.327848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844780160:12345-0@lo:41: Request processed in 91us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864663.327856:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787864663.327939:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844780160:0@lo:41: 00010000:00010000:0.0:1787864663.385318:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864663.833099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844780416:0@lo:13: 00000100:00100000:0.0:1787864663.833109:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844780288:0@lo:13: 00000100:00100000:2.0:1787864663.833748:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844780544:0@lo:400: 00000100:00100000:3.0:1787864663.834577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.834652:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844780928:0@lo:400: 00000100:00100000:3.0:1787864663.834801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.834822:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844781440:0@lo:400: 00000100:00100000:3.0:1787864663.834858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.834883:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787864663.834946:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844780800:0@lo:400: 00000100:00100000:3.0:1787864663.834973:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.834992:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844781312:0@lo:400: 00000100:00100000:3.0:1787864663.835078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.835114:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844780672:0@lo:400: 00000100:00100000:3.0:1787864663.835139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.835155:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844781184:0@lo:400: 00000100:00100000:3.0:1787864663.835175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864663.835271:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780416 00000100:00100000:3.0:1787864663.835280:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780416 00000100:00100000:3.0:1787864663.835399:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864663.835410:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844780416:12345-0@lo:13: 00002000:00000024:3.0:1787864663.835447:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864663.835498:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844780416:12345-0@lo:13: Request processed in 91us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.835518:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864663.835552:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780928 00000100:00100000:3.0:1787864663.835555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780928 00000100:00100000:3.0:1787864663.835581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780672 00000100:00100000:3.0:1787864663.835584:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780672 00000100:00100000:3.0:1787864663.835596:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781184 00000100:00100000:3.0:1787864663.835599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781184 00000100:00100000:3.0:1787864663.835614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787864663.835620:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844780928:12345-0@lo:400: 00000100:00100000:3.0:1787864663.835667:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844780928:12345-0@lo:400: Request processed in 47us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.835830:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787864663.835844:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864663.835850:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844780672:12345-0@lo:400: 00000100:00100000:3.0:1787864663.835913:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844780672:12345-0@lo:400: Request processed in 36us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.835920:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787864663.835931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864663.835937:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844781184:12345-0@lo:400: 00000100:00100000:3.0:1787864663.835963:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844781184:12345-0@lo:400: Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.835968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864663.835985:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780800 00000100:00100000:3.0:1787864663.835989:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780800 00000100:00100000:3.0:1787864663.836022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864663.836028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844780800:12345-0@lo:400: 00000100:00100000:3.0:1787864663.836057:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844780800:12345-0@lo:400: Request processed in 30us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.836063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864663.836120:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844780800:0@lo:400: 00010000:00080000:3.0:1787864663.836134:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc70c0 x1874711844780928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864663.836145:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844780928:0@lo:400: 00010000:00080000:3.0:1787864663.836155:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558999e00 x1874711844780416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864663.836169:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844780416:0@lo:13: 00000100:00100000:1.0:1787864663.836184:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781440 00000100:00100000:1.0:1787864663.836189:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781440 00000100:00100000:1.0:1787864663.836230:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781312 00000100:00100000:1.0:1787864663.836234:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781312 00000100:00100000:1.0:1787864663.836253:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864663.836259:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844781440:12345-0@lo:400: 00000100:00100000:1.0:1787864663.836295:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844781440:12345-0@lo:400: Request processed in 36us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864663.836301:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864663.836313:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787864663.836315:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274472c61c0 x1874711844781440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864663.836319:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844781312:12345-0@lo:400: 00000100:00100000:3.0:1787864663.836325:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844781440:0@lo:400: 00000100:00100000:1.0:1787864663.836347:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844781312:12345-0@lo:400: Request processed in 29us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864663.836353:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787864663.836433:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc6d00 x1874711844780672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864663.836443:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844780672:0@lo:400: 00010000:00080000:3.0:1787864663.836453:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc4780 x1874711844781184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864663.836460:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844781184:0@lo:400: 00010000:00080000:3.0:1787864663.836489:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92754cf830c0 x1874711844781312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864663.836497:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844781312:0@lo:400: 00000100:00100000:0.0:1787864663.836620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864663.836667:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864663.836718:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844781056:0@lo:400: 00000100:00100000:2.0:1787864663.836745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864663.836774:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781056 00000100:00100000:2.0:1787864663.836778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781056 00000100:00100000:2.0:1787864663.836806:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864663.836812:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844781056:12345-0@lo:400: 00000100:00100000:2.0:1787864663.836861:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844781056:12345-0@lo:400: Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864663.836866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787864663.836908:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864663.836914:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864663.836917:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864663.836933:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780544 00000100:00100000:2.0:1787864663.836936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780544 00000100:00100000:2.0:1787864663.836962:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787864663.836967:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3637:x1874711844780544:12345-0@lo:400: 00000100:00100000:2.0:1787864663.836997:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3637:x1874711844780544:12345-0@lo:400: Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864663.837003:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787864663.837104:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844780288 00000100:00100000:3.0:1787864663.837109:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844780288 00000100:00100000:3.0:1787864663.837139:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787864663.837146:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844780288:12345-0@lo:13: 00000100:00100000:2.0:1787864663.837159:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844780544:0@lo:400: 00002000:00000024:3.0:1787864663.837166:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1787864663.837170:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757bcc61c0 x1874711844781056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864663.837179:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844781056:0@lo:400: 00000100:00100000:3.0:1787864663.837203:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844780288:12345-0@lo:13: Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864663.837210:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787864663.837270:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927558998780 x1874711844780288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864663.837284:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844780288:0@lo:13: 00010000:00010000:3.0:1787864664.409190:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864664.857116:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864664.857155:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844781568:0@lo:41: 00000100:00100000:0.0:1787864664.857248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864664.857358:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781568 00000100:00100000:0.0:1787864664.857367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781568 00000100:00100000:0.0:1787864664.857428:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864664.857454:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844781568:12345-0@lo:41: 00000004:00000024:0.0:1787864664.857506:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787864664.857557:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844781568:12345-0@lo:41: Request processed in 104us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864664.857565:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864664.857618:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844781568:0@lo:41: 00010000:00010000:3.0:1787864665.433476:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787864665.884846:0:9502:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787864665.884852:0:9502:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787864665.884854:0:9502:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787864665.885047:0:9502:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92757de48800 00000020:01000004:3.0:1787864665.885067:0:9502:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787864665.885084:0:9502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787864665.885101:0:9502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92757bc31a48) 00000020:00000080:3.0:1787864665.885122:0:9502:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787864665.960181:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787864665.960256:0:9502:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1787864665.988164:0:9502:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787864665.988408:0:9502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787864665.988425:0:9502:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787864665.988439:0:9502:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2fcb8c294dc43131 00000020:01000004:3.0:1787864665.988447:0:9502:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787864665.988473:0:9502:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787864665.988478:0:9502:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787864665.988485:0:9502:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787864665.988529:0:9502:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787864665.988534:0:9502:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787864666.013675:0:9502:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787864666.013775:0:9502:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.136@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1787864666.013780:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787864666.013782:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787864666.013783:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864666.013789:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864666.013790:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864666.013791:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864666.013793:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864666.013794:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864666.013796:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864666.013797:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864666.013799:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787864666.013803:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1787864666.013805:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864666.013806:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787864666.013807:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864666.013808:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864666.013809:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864666.013810:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864666.013811:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864666.013812:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864666.013813:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864666.013814:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864666.013815:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787864666.013848:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787864666.013871:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844781696:0@lo:253: 00000100:00100000:3.0:1787864666.013991:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864666.014125:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.014136:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781696 00000100:00100000:0.0:1787864666.014147:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781696 00000100:00100000:0.0:1787864666.014227:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787864666.014239:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:9502:x1874711844781696:12345-0@lo:253: 20000000:01000000:0.0:1787864666.014279:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787864666.014284:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787864666.014289:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787864666.014293:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787864666.014598:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864666.014740:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1787864666.014755:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787864666.014774:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1787864666.014780:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787864666.014794:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1787864666.014811:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1787864666.014944:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1787864666.014960:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:0.0:1787864666.014963:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787864666.014990:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1787864666.014998:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787864666.015013:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1787864666.015019:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:0.0:1787864666.015030:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1787864666.015046:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787864666.015064:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1787864666.015081:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1787864666.015164:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1787864666.015177:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:0.0:1787864666.015178:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787864666.015194:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1787864666.015200:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787864666.015214:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1787864666.015219:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:0.0:1787864666.015231:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1787864666.015236:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787864666.015248:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1787864666.015265:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1787864666.015651:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1787864666.015665:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.136@tcp 20000000:01000000:0.0:1787864666.015666:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.136@tcp (null) (null) (null) 00000040:00080000:0.0:1787864666.015679:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1787864666.015684:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787864666.015696:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1787864666.015701:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.136@tcp (null) (null) 00000040:00080000:0.0:1787864666.015712:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1787864666.015717:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787864666.015728:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1787864666.015764:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1787864666.015779:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787864666.015782:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787864666.015786:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787864666.015836:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787864666.015838:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864666.017537:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864666.017605:0:9508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864666.017622:0:9508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1787864666.018366:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1787864666.018392:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1787864666.018407:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1787864666.018418:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787864666.018420:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864666.021127:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864666.021173:0:9509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864666.021191:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1787864666.021690:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1787864666.021726:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1787864666.021744:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1787864666.021762:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787864666.021766:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787864666.022618:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1787864666.022660:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1787864666.022678:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787864666.022838:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787864666.022865:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787864666.022959:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1787864666.022979:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787864666.022982:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787864666.023783:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1787864666.023998:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1787864666.024028:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1787864666.024045:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1787864666.024055:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787864666.024057:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787864666.025624:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1787864666.025674:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1787864666.025686:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787864666.028260:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787864666.028306:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1787864666.028357:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:3.0:1787864666.028382:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864666.028409:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028433:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028442:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028450:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028457:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028464:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028471:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028478:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028487:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028546:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028577:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.028596:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472ff840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844781824:0@lo:104: 00000100:00100000:3.0:1787864666.028682:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864666.028751:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028760:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.028769:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fe1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844781952:0@lo:104: 00000100:00100000:3.0:1787864666.028792:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864666.028822:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028831:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 21 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.028841:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782080:0@lo:104: 00000100:00100000:0.0:1787864666.028867:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781824 00000100:00100000:3.0:1787864666.028874:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.028883:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781824 00010000:00010000:3.0:1787864666.028926:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.028936:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.028945:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782208:0@lo:104: 00000100:00100000:3.0:1787864666.028982:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864666.028994:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844781952 00000100:00100000:1.0:1787864666.029001:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844781952 00010000:00010000:3.0:1787864666.029015:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.029025:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 21 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.029036:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782336:0@lo:104: 00000100:00100000:1.0:1787864666.029045:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782080 00000100:00100000:1.0:1787864666.029050:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782080 00000100:00100000:1.0:1787864666.029067:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782208 00000100:00100000:1.0:1787864666.029070:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782208 00000100:00100000:3.0:1787864666.029082:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.029083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864666.029110:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6504:x1874711844781952:12345-0@lo:104: 00010000:00010000:0.0:1787864666.029129:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.029215:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864666.029221:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6504:x1874711844781952:12345-0@lo:104: Request processed in 128us (429us total) trans 0 rc 0/0 00010000:00010000:3.0:1787864666.029407:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.029417:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.029426:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782464:0@lo:104: 00000100:00100000:3.0:1787864666.029459:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864666.029479:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.029488:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 21 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.029506:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782592:0@lo:104: 00000100:00100000:3.0:1787864666.029545:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864666.029576:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fe1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844781952:0@lo:104: 00010000:00010000:2.0:1787864666.032173:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864666.032188:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.032199:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864666.032204:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.032214:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864666.032226:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864666.032231:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864666.032358:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.032365:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864666.032390:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.032397:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc430f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430f9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.032413:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864666.032415:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864666.032417:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864666.032507:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864666.032547:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787864666.032583:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.032613:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782336 00000100:00100000:0.0:1787864666.032624:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782336 00000100:00100000:0.0:1787864666.032652:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782464 00000100:00100000:0.0:1787864666.032655:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782464 00000100:00100000:0.0:1787864666.032664:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782592 00000100:00100000:0.0:1787864666.032667:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782592 00000100:00100000:0.0:1787864666.032678:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864666.032686:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+8:6504:x1874711844782080:12345-0@lo:104: 00010000:00010000:0.0:1787864666.032697:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.032756:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864666.032762:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+8:6504:x1874711844782080:12345-0@lo:104: Request processed in 77us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.032768:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864666.032782:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864666.032789:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+7:6504:x1874711844781824:12345-0@lo:104: 00010000:00010000:0.0:1787864666.032796:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.032842:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787864666.032848:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+7:6504:x1874711844781824:12345-0@lo:104: Request processed in 61us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.032853:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864666.032866:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864666.032872:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6504:x1874711844782208:12345-0@lo:104: 00010000:00010000:0.0:1787864666.032879:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.032944:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787864666.032950:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:6504:x1874711844782208:12345-0@lo:104: Request processed in 78us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.032956:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864666.032968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787864666.032974:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6504:x1874711844782336:12345-0@lo:104: 00010000:00010000:0.0:1787864666.032981:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033006:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787864666.033010:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:6504:x1874711844782336:12345-0@lo:104: Request processed in 38us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.033015:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787864666.033027:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864666.033033:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447111450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6504:x1874711844782464:12345-0@lo:104: 00010000:00010000:0.0:1787864666.033040:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033065:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787864666.033070:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447111450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6504:x1874711844782464:12345-0@lo:104: Request processed in 39us (3611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.033075:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864666.033103:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864666.033109:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6504:x1874711844782592:12345-0@lo:104: 00010000:00010000:0.0:1787864666.033117:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033150:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787864666.033155:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6504:x1874711844782592:12345-0@lo:104: Request processed in 47us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.033161:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864666.033187:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844782720:0@lo:103: 00000100:00100000:0.0:1787864666.033218:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787864666.033260:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787864666.033265:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033271:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.033275:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033282:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.033289:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.033294:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.033766:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033774:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.033793:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033800:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173000/0x2fcb8c294dc430d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430dd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033832:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787864666.033836:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033842:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030e00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.033846:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033853:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.033860:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.033865:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.033880:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033906:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.033914:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033920:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030e00/0x2fcb8c294dc4311c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43123 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033929:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787864666.033931:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033947:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.033950:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033956:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.033962:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.033967:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.033980:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.033986:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.033996:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034002:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031400/0x2fcb8c294dc430ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430b3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034011:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864666.034014:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034019:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.034022:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034038:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.034044:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.034049:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.034063:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034069:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.034074:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034080:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43097 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034089:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864666.034092:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034097:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.034100:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034106:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.034112:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.034124:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.034139:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034144:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.034149:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034155:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43051 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43058 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034164:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864666.034167:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034172:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173e00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.034175:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034181:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.034187:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.034193:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.034205:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034211:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.034222:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034229:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4302e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034242:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864666.034243:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864666.034245:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864666.034260:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782720 00000100:00100000:0.0:1787864666.034264:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782720 00010000:00010000:0.0:1787864666.034286:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.034312:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864666.034319:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844782720:12345-0@lo:103: 00010000:00010000:0.0:1787864666.034329:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.034334:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034343:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034356:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796000/0x2fcb8c294dc430f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc430f2 expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034368:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.034404:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3638:x1874711844782720:12345-0@lo:103: Request processed in 86us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.034410:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864666.034433:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844782848:0@lo:103: 00000100:00100000:0.0:1787864666.034469:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.034507:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844783360:0@lo:103: 00000100:00100000:0.0:1787864666.034525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.034554:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787864666.034559:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844782976:0@lo:103: 00000100:00100000:0.0:1787864666.034588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.034596:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844783488:0@lo:103: 00000100:00100000:0.0:1787864666.034626:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.034650:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782848 00000100:00100000:0.0:1787864666.034654:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782848 00010000:00010000:0.0:1787864666.034668:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 21 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.034681:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783360 00000100:00100000:0.0:1787864666.034684:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783360 00010000:00010000:0.0:1787864666.034693:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.034704:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844782976 00000100:00100000:0.0:1787864666.034706:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844782976 00010000:00010000:0.0:1787864666.034715:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 23 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.034724:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783488 00000100:00100000:0.0:1787864666.034726:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783488 00010000:00010000:0.0:1787864666.034735:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 24 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.034746:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864666.034751:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844782848:12345-0@lo:103: 00010000:00010000:0.0:1787864666.034765:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.034770:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 24 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034777:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 24 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034786:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.034814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844782848:12345-0@lo:103: Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.034821:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864666.034833:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864666.034839:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3639:x1874711844783360:12345-0@lo:103: 00010000:00010000:0.0:1787864666.034846:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.034851:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 23 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034859:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 23 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034869:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.034910:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3639:x1874711844783360:12345-0@lo:103: Request processed in 71us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.034916:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864666.034929:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864666.034936:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3639:x1874711844782976:12345-0@lo:103: 00010000:00010000:0.0:1787864666.034944:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.034948:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034964:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.034973:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.034996:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3639:x1874711844782976:12345-0@lo:103: Request processed in 61us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.035002:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864666.035038:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787864666.035044:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3639:x1874711844783488:12345-0@lo:103: 00010000:00010000:0.0:1787864666.035051:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.035056:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 21 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035063:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 21 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035071:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.035092:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3639:x1874711844783488:12345-0@lo:103: Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.035098:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787864666.035124:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844783232:0@lo:103: 00000100:00100000:0.0:1787864666.035147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.035175:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844782720:0@lo:103: 00000100:00100000:0.0:1787864666.035191:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864666.035196:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844783104:0@lo:103: 00000100:00100000:0.0:1787864666.035217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.035246:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783232 00000100:00100000:0.0:1787864666.035250:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783232 00010000:00010000:0.0:1787864666.035265:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 21 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035278:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783104 00000100:00100000:0.0:1787864666.035280:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783104 00010000:00010000:0.0:1787864666.035289:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 22 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035300:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864666.035305:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844783232:12345-0@lo:103: 00010000:00010000:0.0:1787864666.035311:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.035315:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 22 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035323:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 22 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035332:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.035355:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844783232:12345-0@lo:103: Request processed in 50us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.035361:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864666.035372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864666.035378:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3638:x1874711844783104:12345-0@lo:103: 00010000:00010000:0.0:1787864666.035385:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.035389:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035397:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 21 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035415:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035423:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035436:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035443:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035450:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035456:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035463:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864666.035467:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035474:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035482:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035502:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.035526:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3638:x1874711844783104:12345-0@lo:103: Request processed in 148us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.035541:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864666.035568:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844783104:0@lo:103: 00000100:00100000:0.0:1787864666.035576:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844783232:0@lo:103: 00000100:00100000:0.0:1787864666.035598:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844782976:0@lo:103: 00000100:00100000:0.0:1787864666.035605:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844783488:0@lo:103: 00000100:00100000:0.0:1787864666.035611:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844782848:0@lo:103: 00000100:00100000:0.0:1787864666.035617:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844783360:0@lo:103: 00010000:00010000:0.0:1787864666.035632:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864666.035652:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030000/0x2fcb8c294dc43123 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4311c expref: 20 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035661:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472ff840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844781824:0@lo:104: 00010000:00010000:0.0:1787864666.035670:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949800/0x2fcb8c294dc430dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc430d6 expref: 19 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035677:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782080:0@lo:104: 00010000:00010000:0.0:1787864666.035686:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797800/0x2fcb8c294dc430b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc430ac expref: 18 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035693:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782208:0@lo:104: 00010000:00010000:0.0:1787864666.035702:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796e00/0x2fcb8c294dc43097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43090 expref: 17 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035709:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782336:0@lo:104: 00010000:00010000:0.0:1787864666.035729:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582172c00/0x2fcb8c294dc43058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43051 expref: 16 pid: 6504 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035737:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782464:0@lo:104: 00010000:00010000:0.0:1787864666.035746:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030400/0x2fcb8c294dc4302e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43027 expref: 15 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.035753:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1874711844782592:0@lo:104: 00010000:00010000:0.0:1787864666.035776:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035783:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035789:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.035794:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582173400/0x2fcb8c294dc43138 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787864666.035804:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787864666.040737:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:9502:x1874711844781696:12345-0@lo:253: Request processed in 26494us (26740us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864666.040751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787864666.040829:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844781696:0@lo:253: 10000000:01000000:0.0:1787864666.040852:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787864666.040857:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787864666.040859:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787864666.040860:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864666.040862:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787864666.040863:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864666.040864:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864666.040866:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864666.040868:0:9502:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787864666.040881:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864666.040883:0:9502:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787864666.040956:0:9502:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92757de48800 from lustre-OST0001 10000000:01000000:0.0:1787864666.040996:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787864666.041000:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787864666.041013:0:9502:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92755ed9ced8 local copy 10000000:01000000:0.0:1787864666.041018:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787864666.041066:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.041080:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.041092:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.041117:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783616:0@lo:101: 00000100:00100000:0.0:1787864666.041179:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.041225:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864666.041263:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783616 00000100:00100000:2.0:1787864666.041273:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783616 00000100:00100000:2.0:1787864666.041337:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787864666.041347:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+14:9502:x1874711844783616:12345-0@lo:101: 00010000:00010000:2.0:1787864666.041373:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864666.041391:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797200/0x2fcb8c294dc43146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4313f expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.041417:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797200/0x2fcb8c294dc43146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4313f expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.041428:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797200/0x2fcb8c294dc43146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4313f expref: 15 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.041437:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797200, rc 0) 00000100:00100000:2.0:1787864666.047922:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844783616:12345-0@lo:101: Request processed in 6568us (6734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.047935:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787864666.048156:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783616:0@lo:101: 00010000:00010000:0.0:1787864666.048180:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.048192:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864666.048313:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783744:0@lo:501: 00000100:00100000:0.0:1787864666.048448:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.048533:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864666.048772:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783744 00000100:00100000:1.0:1787864666.048779:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783744 00000100:00100000:1.0:1787864666.048855:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787864666.048864:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844783744:12345-0@lo:501: 00000100:00100000:1.0:1787864666.048963:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844783744:12345-0@lo:501: Request processed in 100us (515us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864666.048969:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787864666.049034:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783744:0@lo:501: 10000000:01000000:2.0:1787864666.049048:0:9502:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787864666.049069:0:9502:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787864666.049074:0:9502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.049084:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.049090:0:9502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.049110:0:9502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787864666.049140:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92757de48800 10000000:01000000:2.0:1787864666.049144:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787864666.049149:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787864666.049151:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864666.049155:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787864666.049158:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787864666.049180:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.049187:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.049194:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.049206:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783872:0@lo:101: 00000100:00100000:2.0:1787864666.049233:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.049536:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.049610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844783872 00000100:00100000:0.0:1787864666.049615:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844783872 00000100:00100000:0.0:1787864666.049647:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787864666.049653:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844783872:12345-0@lo:101: 00010000:00010000:0.0:1787864666.049662:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864666.049843:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4314d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.049863:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.049873:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.049881:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:0.0:1787864666.049955:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844783872:12345-0@lo:101: Request processed in 301us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.049961:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:0.0:1787864666.049987:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864666.049993:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.049999:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864666.050003:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.050010:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864666.050017:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864666.050033:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864666.050056:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.050063:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864666.050085:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.050093:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030600/0x2fcb8c294dc4313f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2fcb8c294dc43146 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.050106:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864666.050108:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864666.050110:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864666.050117:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864666.050129:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844784000:0@lo:103: 00000100:00100000:0.0:1787864666.050157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864666.050184:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784000 00000100:00100000:0.0:1787864666.050188:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784000 00000100:00100000:0.0:1787864666.050216:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864666.050223:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3638:x1874711844784000:12345-0@lo:103: 00010000:00010000:0.0:1787864666.050231:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864666.050242:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797200/0x2fcb8c294dc43146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc4313f expref: 16 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.050252:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864666.050277:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3638:x1874711844784000:12345-0@lo:103: Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.050294:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864666.050327:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844784000:0@lo:103: 00000100:00100000:2.0:1787864666.050406:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844783872:0@lo:101: 00010000:00010000:2.0:1787864666.050419:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.050428:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.050514:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784128:0@lo:501: 00000100:00100000:2.0:1787864666.050539:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.050582:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.051091:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784128 00000100:00100000:0.0:1787864666.051097:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784128 00000100:00100000:0.0:1787864666.051126:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864666.051133:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784128:12345-0@lo:501: 00000100:00100000:0.0:1787864666.051238:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784128:12345-0@lo:501: Request processed in 105us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.051245:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787864666.051331:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784128:0@lo:501: 00000100:00100000:2.0:1787864666.051373:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784256:0@lo:503: 00000100:00100000:2.0:1787864666.051418:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.051444:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.052072:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784256 00000100:00100000:0.0:1787864666.052078:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784256 00000100:00100000:0.0:1787864666.052104:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787864666.052111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784256:12345-0@lo:503: 00000100:00100000:0.0:1787864666.052201:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784256:12345-0@lo:503: Request processed in 90us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.052208:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787864666.052337:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784256:0@lo:503: 00000040:00080000:2.0:1787864666.052603:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864666.052794:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784384:0@lo:502: 00000100:00100000:2.0:1787864666.052835:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.052870:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.053134:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784384 00000100:00100000:0.0:1787864666.053139:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784384 00000100:00100000:0.0:1787864666.053164:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787864666.053171:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784384:12345-0@lo:502: 00000100:00100000:0.0:1787864666.053270:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784384:12345-0@lo:502: Request processed in 99us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.053277:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787864666.053364:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784384:0@lo:502: 00000040:00080000:1.0:1787864666.053587:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787864666.053612:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787864666.053625:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787864666.053637:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787864666.053649:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787864666.053660:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787864666.053698:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784512:0@lo:502: 00000100:00100000:1.0:1787864666.053733:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864666.053761:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.053960:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784512 00000100:00100000:0.0:1787864666.053965:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784512 00000100:00100000:0.0:1787864666.053987:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787864666.054002:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784512:12345-0@lo:502: 00000100:00100000:0.0:1787864666.054078:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784512:12345-0@lo:502: Request processed in 77us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.054085:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787864666.054167:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784512:0@lo:502: 00000040:00080000:1.0:1787864666.054206:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787864666.054214:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1787864666.054781:0:9513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787864666.054789:0:9513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787864666.054795:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864666.054797:0:9513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787864666.054803:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864666.054817:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92755ed9b490) 00000020:00000080:1.0:1787864666.054839:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787864666.054846:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787864666.054944:0:9513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757de48800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787864666.054952:0:9513:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787864666.054959:0:9513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2fcb8c294dc43162 00010000:00010000:0.0:1787864666.062812:0:9513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1787864666.063297:0:9513:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787864666.066671:0:9513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787864666.067039:0:9513:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787864666.074348:0:9513:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787864666.074570:0:9513:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1787864666.083568:0:9513:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1787864666.088790:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787864666.088802:0:9513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864666.088808:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864666.088810:0:9513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787864666.088814:0:9513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864666.088818:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864666.088820:0:9513:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787864666.088823:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787864666.088825:0:9513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787864666.088843:0:9513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864666.088846:0:9513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864666.088848:0:9513:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787864666.088852:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787864666.089083:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787864666.089111:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787864666.089132:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.089144:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864666.089152:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757de48800 from 1 10000000:01000000:3.0:1787864666.089155:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864666.089187:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.089195:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864666.089206:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864666.089226:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784640:0@lo:101: 00000100:00100000:3.0:1787864666.089286:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864666.089325:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.091327:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784640 00000100:00100000:0.0:1787864666.091338:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784640 00000100:00100000:0.0:1787864666.091409:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787864666.091551:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:9502:x1874711844784640:12345-0@lo:101: 00010000:00010000:0.0:1787864666.091568:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864666.091585:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43169 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.091618:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.091629:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.091638:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:0.0:1787864666.091766:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844784640:12345-0@lo:101: Request processed in 349us (2479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864666.095249:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784640:0@lo:101: 00010000:00010000:1.0:1787864666.095278:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.095291:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864666.095565:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784768:0@lo:501: 00000100:00100000:1.0:1787864666.095620:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864666.096513:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864666.096640:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784768 00000100:00100000:3.0:1787864666.096648:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784768 00000100:00100000:0.0:1787864666.101373:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787864666.101636:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787864666.101652:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844784768:12345-0@lo:501: 00000100:00100000:3.0:1787864666.101996:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844784768:12345-0@lo:501: Request processed in 350us (6375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864666.102004:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787864666.104539:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784768:0@lo:501: 00000100:00100000:2.0:1787864666.104785:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784896:0@lo:503: 00000100:00100000:2.0:1787864666.104856:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.104912:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.105224:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844784896 00000100:00100000:0.0:1787864666.105231:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844784896 00000100:00100000:0.0:1787864666.105288:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864666.105298:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844784896:12345-0@lo:503: 00000100:00100000:0.0:1787864666.105434:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844784896:12345-0@lo:503: Request processed in 137us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.105441:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787864666.105543:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844784896:0@lo:503: 00000040:00080000:2.0:1787864666.106009:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864666.106088:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785024:0@lo:502: 00000100:00100000:2.0:1787864666.106132:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.106215:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864666.107685:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785024 00000100:00100000:3.0:1787864666.107766:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785024 00000100:00100000:3.0:1787864666.107854:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787864666.107863:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844785024:12345-0@lo:502: 00000100:00100000:3.0:1787864666.108040:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844785024:12345-0@lo:502: Request processed in 177us (1906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864666.108048:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787864666.108498:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785024:0@lo:502: 00000040:00080000:2.0:1787864666.108753:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787864666.108783:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787864666.108813:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785152:0@lo:502: 00000100:00100000:2.0:1787864666.108861:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.108916:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864666.109126:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785152 00000100:00100000:3.0:1787864666.109131:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785152 00000100:00100000:1.0:1787864666.109173:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787864666.109185:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844785152:12345-0@lo:502: 00000100:00100000:1.0:1787864666.109299:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844785152:12345-0@lo:502: Request processed in 117us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864666.109311:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864666.109338:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785152:0@lo:502: 00000040:00080000:2.0:1787864666.109378:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787864666.109385:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787864666.111541:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864666.111551:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864666.111554:0:9517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787864666.111560:0:9517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92757de48800 00000020:00000080:0.0:1787864666.111563:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787864666.111581:0:9517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864666.111584:0:9517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864666.111586:0:9517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787864666.111589:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787864666.111688:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787864666.111719:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864666.111741:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.111752:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864666.111800:0:9502:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787864666.111803:0:9502:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92757de48800 10000000:01000000:2.0:1787864666.111806:0:9502:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92757de48800 10000000:01000000:2.0:1787864666.111810:0:9502:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864666.111815:0:9502:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92757de48800 from 1 10000000:01000000:2.0:1787864666.111818:0:9502:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864666.111848:0:9502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.111863:0:9502:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.111874:0:9502:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.111916:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785280:0@lo:101: 00000100:00100000:2.0:1787864666.111969:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.112004:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.114092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785280 00000100:00100000:0.0:1787864666.114104:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785280 00000100:00100000:0.0:1787864666.114178:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787864666.114188:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9502:x1874711844785280:12345-0@lo:101: 00010000:00010000:0.0:1787864666.114204:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864666.114220:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43177 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.114245:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.114256:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.114266:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:0.0:1787864666.114340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785280:12345-0@lo:101: Request processed in 154us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864666.114347:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787864666.114384:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785280:0@lo:101: 00010000:00010000:2.0:1787864666.114402:0:9502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.114411:0:9502:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.114529:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785408:0@lo:501: 00000100:00100000:2.0:1787864666.114669:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.114695:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864666.115080:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785408 00000100:00100000:1.0:1787864666.115085:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785408 00000100:00100000:1.0:1787864666.115126:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787864666.115135:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785408:12345-0@lo:501: 00000100:00100000:1.0:1787864666.115253:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785408:12345-0@lo:501: Request processed in 120us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864666.115260:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787864666.115406:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785408:0@lo:501: 00000100:00100000:2.0:1787864666.115441:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785536:0@lo:503: 00000100:00100000:2.0:1787864666.115484:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.115527:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787864666.115616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785536 00000100:00100000:3.0:1787864666.115627:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785536 00000100:00100000:3.0:1787864666.115709:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787864666.115717:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785536:12345-0@lo:503: 00000100:00100000:3.0:1787864666.115931:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785536:12345-0@lo:503: Request processed in 214us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864666.115938:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787864666.116070:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785536:0@lo:503: 00000040:00080000:2.0:1787864666.116306:0:9502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864666.116379:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785664:0@lo:502: 00000100:00100000:2.0:1787864666.116420:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.122636:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864666.122685:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785664 00000100:00100000:1.0:1787864666.122693:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785664 00000100:00100000:1.0:1787864666.122820:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787864666.122830:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785664:12345-0@lo:502: 00000100:00100000:1.0:1787864666.123148:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785664:12345-0@lo:502: Request processed in 320us (6727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864666.123157:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787864666.123242:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785664:0@lo:502: 00000040:00080000:2.0:1787864666.123986:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787864666.124078:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787864666.124094:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787864666.124109:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787864666.124122:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787864666.124135:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787864666.124149:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787864666.124163:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787864666.124177:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787864666.124191:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787864666.124207:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787864666.124221:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787864666.124235:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787864666.124249:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787864666.124263:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787864666.124276:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787864666.124288:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787864666.124300:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787864666.124314:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787864666.124327:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787864666.124341:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787864666.124353:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787864666.124366:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787864666.124379:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787864666.124407:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1787864666.124422:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1787864666.124567:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1787864666.124594:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1787864666.124607:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1787864666.124620:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1787864666.124632:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1787864666.124644:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1787864666.124656:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1787864666.124668:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1787864666.124681:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1787864666.124694:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1787864666.124706:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1787864666.124720:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1787864666.124795:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1787864666.124814:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1787864666.124838:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1787864666.124852:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1787864666.124864:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1787864666.124876:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1787864666.125151:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1787864666.125175:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1787864666.125215:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785792:0@lo:502: 00000100:00100000:2.0:1787864666.125278:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.125364:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864666.125403:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785792 00000100:00100000:1.0:1787864666.125409:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785792 00000100:00100000:1.0:1787864666.126369:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787864666.126390:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785792:12345-0@lo:502: 00000100:00100000:1.0:1787864666.126667:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844785792:12345-0@lo:502: Request processed in 279us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864666.126675:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787864666.129344:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844785792:0@lo:502: 00000040:00080000:2.0:1787864666.129717:0:9502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1787864666.129778:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787864666.130700:0:9518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787864666.130715:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92755ed98000) 00000020:00000080:1.0:1787864666.130799:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787864666.130932:0:9518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757de48800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787864666.130937:0:9518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757de48800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787864666.130940:0:9518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757de48800 3 00010000:00080000:1.0:1787864666.130969:0:9518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927447eba800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.136@tcp at head 00010000:00010000:1.0:1787864666.134613:0:9518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787864666.134978:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787864666.135689:0:9518:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787864666.135702:0:9518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2fcb8c294dc4318c 00000100:00080000:1.0:1787864666.135712:0:9518:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864666.135717:0:9518:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff927447eba800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864666.135819:0:9518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274472c70c0 x1874711844785920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864666.135849:0:9518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787864666.135947:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844785920:0@lo:38: 00000100:00100000:0.0:1787864666.136025:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1787864666.137206:0:9518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:2.0:1787864666.138046:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844785920 00000100:00100000:2.0:1787864666.138054:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844785920 00000100:00100000:2.0:1787864666.138090:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864666.138098:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844785920:12345-0@lo:38: 00010000:00080000:2.0:1787864666.138123:0:6511:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1787864666.138163:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2fcb8c294dc43193 00000004:00100000:2.0:1787864666.138179:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787864666.138210:0:6511:0:(import.c:65:import_set_state_nolock()) ffff92757fa97800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864666.138286:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874711844785920:12345-0@lo:38: Request processed in 187us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.138294:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864666.138320:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844786048:0@lo:400: 00000100:00100000:2.0:1787864666.138351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138373:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844786560:0@lo:400: 00000100:00100000:2.0:1787864666.138394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138413:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787864666.138419:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844786432:0@lo:400: 00000100:00100000:2.0:1787864666.138444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138461:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844786944:0@lo:400: 00000100:00100000:2.0:1787864666.138484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138526:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844786176:0@lo:400: 00000100:00100000:2.0:1787864666.138548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138566:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844786688:0@lo:400: 00000100:00100000:2.0:1787864666.138586:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138603:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787864666.138609:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844786304:0@lo:400: 00000100:00100000:2.0:1787864666.138630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138641:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844786816:0@lo:400: 00000100:00100000:2.0:1787864666.138671:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.138703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786048 00000100:00100000:2.0:1787864666.138713:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786048 00000100:00100000:2.0:1787864666.138745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786560 00000100:00100000:2.0:1787864666.138748:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786560 00000100:00100000:2.0:1787864666.138768:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786688 00000100:00100000:2.0:1787864666.138771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786688 00000100:00100000:2.0:1787864666.138783:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786304 00000100:00100000:2.0:1787864666.138786:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786304 00000100:00100000:2.0:1787864666.138799:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864666.138804:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844786048:12345-0@lo:400: 00000100:00100000:2.0:1787864666.138841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844786048:12345-0@lo:400: Request processed in 37us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.138848:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864666.138860:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864666.138866:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844786560:12345-0@lo:400: 00000100:00100000:2.0:1787864666.138915:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844786560:12345-0@lo:400: Request processed in 49us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.138921:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864666.138932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864666.138938:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844786688:12345-0@lo:400: 00000100:00100000:2.0:1787864666.138969:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844786688:12345-0@lo:400: Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.138975:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864666.138985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864666.138991:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844786304:12345-0@lo:400: 00000100:00100000:2.0:1787864666.139019:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844786304:12345-0@lo:400: Request processed in 28us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.139024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864666.139047:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786432 00000100:00100000:2.0:1787864666.139056:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786432 00000100:00100000:2.0:1787864666.139082:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786176 00000100:00100000:2.0:1787864666.139085:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786176 00000100:00100000:2.0:1787864666.139096:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864666.139101:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844786432:12345-0@lo:400: 00000100:00100000:2.0:1787864666.139133:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844786432:12345-0@lo:400: Request processed in 31us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.139139:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864666.139150:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787864666.139156:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844786176:12345-0@lo:400: 00000100:00100000:2.0:1787864666.139182:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844786176:12345-0@lo:400: Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.139187:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00000080:1.0:1787864666.139245:0:9518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff927447fd3490) 00000020:00000080:1.0:1787864666.139264:0:9518:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1787864666.139349:0:9518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92757de48800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787864666.139354:0:9518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757de48800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787864666.139356:0:9518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757de48800 3 00010000:00080000:1.0:1787864666.139383:0:9518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927447ebf800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.136@tcp at head 00010000:00010000:1.0:1787864666.141666:0:9518:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00080000:1.0:1787864666.144227:0:9519:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9274472c5a40 x1874711844787072/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864666.144240:0:9519:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ece480 going to sleep for 0 seconds 00000100:00100000:2.0:1787864666.144473:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786944 00000100:00100000:2.0:1787864666.144480:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786944 00000100:00100000:2.0:1787864666.144538:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844786816 00000100:00100000:2.0:1787864666.144541:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844786816 00000100:00100000:2.0:1787864666.144566:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864666.144574:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844786944:12345-0@lo:400: 00000100:00100000:2.0:1787864666.144664:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844786944:12345-0@lo:400: Request processed in 90us (6178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.144671:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864666.144687:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864666.144694:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844786816:12345-0@lo:400: 00000100:00100000:2.0:1787864666.144722:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844786816:12345-0@lo:400: Request processed in 30us (6051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.145181:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787864666.145212:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864666.145223:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864666.145225:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787864666.145271:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274472c70c0 x1874711844785920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145282:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787864666.145290:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787864666.145297:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787864666.145301:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787864666.145305:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787864666.145312:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cea47097): req@ffff9274472c5a40 x1874711844787072/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145335:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844785920:0@lo:38: 00010000:00080000:2.0:1787864666.145373:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccf480 x1874711844786304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145383:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844786304:0@lo:400: 00010000:00080000:2.0:1787864666.145393:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccc3c0 x1874711844786816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145401:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844786816:0@lo:400: 00000100:00100000:2.0:1787864666.145410:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844786176:0@lo:400: 00010000:00080000:2.0:1787864666.145420:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccde00 x1874711844786688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145428:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844786688:0@lo:400: 00000100:00100000:2.0:1787864666.145458:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844786432:0@lo:400: 00010000:00080000:2.0:1787864666.145468:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dcce1c0 x1874711844786944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145485:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844786944:0@lo:400: 00010000:00080000:2.0:1787864666.145511:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccc780 x1874711844786048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145520:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844786048:0@lo:400: 00010000:00080000:2.0:1787864666.145530:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dccf0c0 x1874711844786560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.145539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844786560:0@lo:400: 00000100:00100000:1.0:1787864666.146913:0:9519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864666.146941:0:9519:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ece480 going to sleep for 11 seconds 00000020:00000080:1.0:1787864666.147072:0:9518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787864666.147118:0:9518:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787864666.147130:0:9518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2fcb8c294dc431a1 00000100:00080000:1.0:1787864666.147138:0:9518:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864666.147143:0:9518:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff927447ebf800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864666.147169:0:9518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274472c4f00 x1874711844787200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864666.147187:0:9518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787864666.147394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787072 00000100:00100000:2.0:1787864666.147400:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787072 00000100:00100000:2.0:1787864666.147453:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864666.147462:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9519:x1874711844787072:12345-0@lo:901: 00000100:00100000:2.0:1787864666.147563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9519:x1874711844787072:12345-0@lo:901: Request processed in 102us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.147570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787864666.147587:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864666.147612:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844787200:0@lo:38: 00000100:00100000:2.0:1787864666.147644:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.147682:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787200 00000100:00100000:2.0:1787864666.147686:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787200 00000100:00100000:2.0:1787864666.147706:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864666.147711:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844787200:12345-0@lo:38: 00010000:00080000:1.0:1787864666.147836:0:9519:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274472c5a40 x1874711844787072/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787864682 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864666.147847:0:9519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5a40 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9519:1874711844787072:0@lo:901: 00010000:00080000:2.0:1787864666.148040:0:6510:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1787864666.148072:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2fcb8c294dc431a8 00000004:00100000:2.0:1787864666.148088:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787864666.148123:0:6510:0:(import.c:65:import_set_state_nolock()) ffff92757fa90000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864666.148165:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874711844787200:12345-0@lo:38: Request processed in 452us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.148172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787864666.148201:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274472c4f00 x1874711844787200/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864666.148209:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787864666.148214:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787864666.148220:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787864666.148225:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787864666.148227:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927447ebf800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787864666.148233:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844787200:0@lo:38: 00000040:00080000:1.0:1787864666.149409:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1787864666.149797:0:9502:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1787864666.149836:0:9502:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864666.149859:0:9502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.149870:0:9502:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787864666.149944:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787864666.149947:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864666.149948:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864666.149949:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864666.149951:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864666.149953:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864666.149954:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864666.149956:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864666.149958:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864666.149959:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864666.149966:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787864666.149969:0:9502:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787864666.149972:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787864666.149973:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864666.149975:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864666.149976:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864666.149977:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864666.149978:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864666.149979:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864666.149980:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787864666.149980:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787864666.149981:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864666.149982:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787864666.150008:0:9502:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787864666.150023:0:9502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844787328:0@lo:253: 00000100:00100000:2.0:1787864666.150075:0:9502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.150109:0:9502:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864666.150454:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787328 00000100:00100000:0.0:1787864666.150460:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787328 00000100:00100000:0.0:1787864666.150515:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787864666.150524:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844787328:12345-0@lo:253: 20000000:01000000:0.0:1787864666.150550:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787864666.150563:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787864666.165950:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787864666.165965:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787864666.166057:0:6526:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787864666.166062:0:6526:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787864666.166083:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166100:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166108:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166116:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166152:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166179:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 17 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.166192:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844787456:0@lo:104: 00000100:00100000:2.0:1787864666.166248:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864666.166822:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 17 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.166832:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 17 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.166841:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844787584:0@lo:104: 00000100:00100000:2.0:1787864666.166868:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.166913:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864666.166932:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787456 00000100:00100000:2.0:1787864666.166937:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787456 00000100:00100000:2.0:1787864666.166970:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787584 00000100:00100000:2.0:1787864666.166972:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787584 00000100:00100000:2.0:1787864666.166985:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864666.166992:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844787456:12345-0@lo:104: 00010000:00010000:2.0:1787864666.167003:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.167057:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864666.167062:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:6526:x1874711844787456:12345-0@lo:104: Request processed in 71us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.167070:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864666.167085:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864666.167098:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844787584:12345-0@lo:104: 00010000:00010000:2.0:1787864666.167106:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.167138:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864666.167143:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:6526:x1874711844787584:12345-0@lo:104: Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.167148:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864666.167182:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844787456:0@lo:104: 00000100:00100000:2.0:1787864666.167191:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6526:1874711844787584:0@lo:104: 00010000:00010000:2.0:1787864666.167208:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.168714:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9502:x1874711844787328:12345-0@lo:253: Request processed in 18186us (18633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.168724:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1787864666.168917:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864666.168925:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.168934:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864666.168938:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.168947:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864666.168967:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864666.168973:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1787864666.168994:0:9502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9502:1874711844787328:0@lo:253: 00010000:00010000:1.0:1787864666.169006:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864666.169009:0:9502:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787864666.169013:0:9502:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864666.169016:0:9502:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00010000:00010000:1.0:1787864666.169018:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:3.0:1787864666.169019:0:9502:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864666.169022:0:9502:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864666.169023:0:9502:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864666.169025:0:9502:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864666.169026:0:9502:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864666.169028:0:9502:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787864666.169029:0:9502:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787864666.169031:0:9502:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864666.169033:0:9502:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1787864666.169036:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1787864666.169045:0:9502:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787864666.169046:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446797400/0x2fcb8c294dc430e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430eb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169062:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864666.169066:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169071:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864666.169074:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169080:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864666.169085:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864666.169090:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864666.169109:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169115:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864666.169126:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169132:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446797600/0x2fcb8c294dc4309e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc430a5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864666.169143:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864666.169144:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864666.169146:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864666.169725:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844787712:0@lo:103: 00000100:00100000:2.0:1787864666.169767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.169820:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844787840:0@lo:103: 00000100:00100000:2.0:1787864666.169842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864666.169871:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787712 00000100:00100000:2.0:1787864666.169876:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787712 00010000:00010000:2.0:1787864666.169919:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 17 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.169940:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787840 00000100:00100000:2.0:1787864666.169943:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787840 00010000:00010000:2.0:1787864666.169953:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 18 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864666.169976:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864666.169983:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3638:x1874711844787712:12345-0@lo:103: 00010000:00010000:2.0:1787864666.169994:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864666.169998:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 18 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170008:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 18 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170021:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796200/0x2fcb8c294dc430eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc430e4 expref: 18 pid: 6505 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170033:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864666.170063:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3638:x1874711844787712:12345-0@lo:103: Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.170070:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864666.170084:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864666.170090:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3639:x1874711844787840:12345-0@lo:103: 00010000:00010000:2.0:1787864666.170097:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864666.170101:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 16 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170110:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 16 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170120:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796a00/0x2fcb8c294dc430a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4309e expref: 16 pid: 6503 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170140:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170148:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864666.170161:0:6498:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006644407s 00010000:00010000:2.0:1787864666.170165:0:6498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170172:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170179:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170186:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170191:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864666.170195:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170202:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170214:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170222:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864666.170248:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3639:x1874711844787840:12345-0@lo:103: Request processed in 158us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864666.170254:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864666.170283:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844787840:0@lo:103: 00000100:00100000:2.0:1787864666.170303:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844787712:0@lo:103: 00010000:00010000:2.0:1787864666.170318:0:6526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170325:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864666.170332:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797000/0x2fcb8c294dc431af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864666.170813:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787864666.178451:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787864666.179138:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787864666.180056:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787864666.180223:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787864666.180462:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1787864666.180621:0:9502:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1787864666.186860:0:9502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787864666.199379:0:9502:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787864666.199388:0:9502:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787864666.199424:0:9502:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787864666.199466:0:9502:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787864666.199508:0:9502:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787864666.199536:0:9502:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787864666.200320:0:9502:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864666.200513:0:9502:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787864666.457200:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787864667.025211:0:9574:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864667.025458:0:9574:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787864667.482461:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864668.442099:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844787968:0@lo:41: 00000100:00100000:2.0:1787864668.442162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864668.442331:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844787968 00000100:00100000:3.0:1787864668.442339:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844787968 00000100:00100000:3.0:1787864668.442389:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864668.442398:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844787968:12345-0@lo:41: 00000004:00000024:3.0:1787864668.442429:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1787864668.442498:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844787968:12345-0@lo:41: Request processed in 101us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864668.442506:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787864668.442577:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844787968:0@lo:41: 00010000:00010000:1.0:1787864668.505978:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864668.953185:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844788096:0@lo:13: 00000100:00100000:2.0:1787864668.953253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864668.953397:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788096 00000100:00100000:3.0:1787864668.953404:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788096 00000100:00100000:3.0:1787864668.953464:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787864668.953483:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844788096:12345-0@lo:13: 00002000:00000024:3.0:1787864668.953509:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864668.953556:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844788096:12345-0@lo:13: Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864668.953564:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787864668.953715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864668.953745:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558999e00 x1874711844788096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864668.953762:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844788096:0@lo:13: 00000100:00100000:2.0:1787864668.955289:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864668.955308:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844788224:0@lo:13: 00000100:00100000:2.0:1787864668.955357:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864668.955447:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788224 00000100:00100000:3.0:1787864668.955453:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788224 00000100:00100000:3.0:1787864668.955520:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864668.955529:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844788224:12345-0@lo:13: 00002000:00000024:3.0:1787864668.955546:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864668.955588:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844788224:12345-0@lo:13: Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864668.955595:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787864668.955689:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864668.955715:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558998780 x1874711844788224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864668.955745:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844788224:0@lo:13: 00010000:00010000:3.0:1787864669.529113:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864669.978947:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864669.978970:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844788352:0@lo:41: 00000100:00100000:0.0:1787864669.979034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864669.979124:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788352 00000100:00100000:2.0:1787864669.979131:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788352 00000100:00100000:2.0:1787864669.979183:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787864669.979193:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844788352:12345-0@lo:41: 00000004:00000024:2.0:1787864669.979225:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787864669.979275:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844788352:12345-0@lo:41: Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864669.979282:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787864669.979322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844788352:0@lo:41: 00010000:00010000:0.0:1787864670.553288:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864671.513738:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844788480:0@lo:400: 00000100:00100000:0.0:1787864671.513771:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844788864:0@lo:400: 00000100:00100000:2.0:1787864671.513806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.513806:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.513856:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844789376:0@lo:400: 00000100:00100000:0.0:1787864671.513881:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514013:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864671.514020:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844789504:0@lo:400: 00000100:00100000:0.0:1787864671.514043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514173:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844788608:0@lo:400: 00000100:00100000:0.0:1787864671.514200:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514218:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844789120:0@lo:400: 00000100:00100000:0.0:1787864671.514237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514252:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844789632:0@lo:400: 00000100:00100000:0.0:1787864671.514269:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514285:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787864671.514289:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844788736:0@lo:400: 00000100:00100000:0.0:1787864671.514310:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514327:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844789248:0@lo:400: 00000100:00100000:0.0:1787864671.514346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514365:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844789760:0@lo:400: 00000100:00100000:0.0:1787864671.514389:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864671.514416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788864 00000100:00100000:0.0:1787864671.514423:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788864 00000100:00100000:0.0:1787864671.514727:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788608 00000100:00100000:0.0:1787864671.514731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788608 00000100:00100000:0.0:1787864671.514748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789120 00000100:00100000:0.0:1787864671.514750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789120 00000100:00100000:0.0:1787864671.514774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789632 00000100:00100000:0.0:1787864671.514776:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789632 00000100:00100000:0.0:1787864671.514787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789248 00000100:00100000:0.0:1787864671.514790:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789248 00000100:00100000:0.0:1787864671.514800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789760 00000100:00100000:0.0:1787864671.514802:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789760 00000100:00100000:0.0:1787864671.514815:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864671.514822:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844788864:12345-0@lo:400: 00000100:00100000:0.0:1787864671.514875:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844788864:12345-0@lo:400: Request processed in 53us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.514882:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864671.515618:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864671.515627:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844788608:12345-0@lo:400: 00000100:00100000:0.0:1787864671.515673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844788608:12345-0@lo:400: Request processed in 48us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.515679:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864671.515692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864671.515699:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844789120:12345-0@lo:400: 00000100:00100000:0.0:1787864671.515726:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844789120:12345-0@lo:400: Request processed in 28us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.515732:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864671.515760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864671.515768:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844789632:12345-0@lo:400: 00000100:00100000:0.0:1787864671.515797:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844789632:12345-0@lo:400: Request processed in 31us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.515802:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864671.515813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864671.515818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844789248:12345-0@lo:400: 00000100:00100000:0.0:1787864671.515843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844789248:12345-0@lo:400: Request processed in 25us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.515848:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864671.515860:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787864671.515866:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844789760:12345-0@lo:400: 00000100:00100000:0.0:1787864671.515901:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844789760:12345-0@lo:400: Request processed in 24us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.515906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787864671.515941:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789376 00000100:00100000:0.0:1787864671.515946:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789376 00000100:00100000:0.0:1787864671.515976:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789504 00000100:00100000:0.0:1787864671.515979:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789504 00000100:00100000:0.0:1787864671.515997:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864671.516003:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844789376:12345-0@lo:400: 00000100:00100000:0.0:1787864671.516033:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844789376:12345-0@lo:400: Request processed in 30us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.516038:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864671.516049:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864671.516054:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844789504:12345-0@lo:400: 00000100:00100000:2.0:1787864671.516468:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844788992:0@lo:400: 00000100:00100000:2.0:1787864671.516504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864671.516550:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788736 00000100:00100000:2.0:1787864671.516554:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788736 00000100:00100000:2.0:1787864671.516582:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788992 00000100:00100000:2.0:1787864671.516585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788992 00000100:00100000:2.0:1787864671.516598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787864671.516603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844788736:12345-0@lo:400: 00000100:00100000:2.0:1787864671.516636:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844788736:12345-0@lo:400: Request processed in 32us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864671.516641:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787864671.516654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787864671.516659:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844788992:12345-0@lo:400: 00000100:00100000:2.0:1787864671.516700:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844788992:12345-0@lo:400: Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864671.516706:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787864671.516737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844788992:0@lo:400: 00000100:00100000:0.0:1787864671.517028:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844789504:12345-0@lo:400: Request processed in 972us (2982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864671.517040:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787864671.517088:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864671.517092:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864671.517094:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787864671.517222:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c930c0 x1874711844789504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517234:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844789504:0@lo:400: 00010000:00080000:0.0:1787864671.517246:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c903c0 x1874711844788864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517254:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844788864:0@lo:400: 00010000:00080000:0.0:1787864671.517265:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91e00 x1874711844789376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517273:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844789376:0@lo:400: 00000100:00100000:0.0:1787864671.517312:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844788736:0@lo:400: 00010000:00080000:0.0:1787864671.517324:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91a40 x1874711844789248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517333:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844789248:0@lo:400: 00010000:00080000:0.0:1787864671.517344:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92754cf830c0 x1874711844789760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517351:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844789760:0@lo:400: 00010000:00080000:0.0:1787864671.517361:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93480 x1874711844788608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517370:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844788608:0@lo:400: 00010000:00080000:0.0:1787864671.517391:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c912c0 x1874711844789120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844789120:0@lo:400: 00010000:00080000:0.0:1787864671.517408:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93840 x1874711844789632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864671.517417:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844789632:0@lo:400: 00000100:00100000:1.0:1787864671.517687:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844788480 00000100:00100000:1.0:1787864671.517693:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844788480 00000100:00100000:1.0:1787864671.517775:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787864671.517783:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3640:x1874711844788480:12345-0@lo:400: 00000100:00100000:1.0:1787864671.517848:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3640:x1874711844788480:12345-0@lo:400: Request processed in 66us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864671.517855:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787864671.518044:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844788480:0@lo:400: 00010000:00010000:2.0:1787864671.578589:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864671.860084:0:9863:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1787864672.522485:0:9915:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864672.522662:0:9915:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787864672.538302:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864672.538310:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92757bdea800 from 39 10000000:01000000:3.0:1787864672.538315:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864672.538358:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.538369:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.538379:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.538402:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844789888:0@lo:101: 00000100:00100000:3.0:1787864672.538475:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.538523:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.540299:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844789888 00000100:00100000:2.0:1787864672.540308:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844789888 00000100:00100000:2.0:1787864672.540360:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787864672.540370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844789888:12345-0@lo:101: 00010000:00010000:2.0:1787864672.540385:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864672.540400:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc431b6 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.540424:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.540437:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.540446:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797800, rc 0) 00000100:00100000:2.0:1787864672.540521:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844789888:12345-0@lo:101: Request processed in 153us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.540529:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787864672.540597:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844789888:0@lo:101: 00010000:00010000:2.0:1787864672.540612:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.540621:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.540697:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790016:0@lo:501: 00000100:00100000:2.0:1787864672.540724:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.540749:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.540763:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790016 00000100:00100000:2.0:1787864672.540767:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790016 00000100:00100000:2.0:1787864672.540790:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787864672.540797:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844790016:12345-0@lo:501: 00000100:00100000:2.0:1787864672.540929:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844790016:12345-0@lo:501: Request processed in 132us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.540936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787864672.540965:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790016:0@lo:501: 00000100:00100000:2.0:1787864672.540992:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790144:0@lo:503: 00000100:00100000:2.0:1787864672.541029:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.541043:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.541054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790144 00000100:00100000:2.0:1787864672.541057:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790144 00000100:00100000:2.0:1787864672.541077:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864672.541083:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844790144:12345-0@lo:503: 00000100:00100000:2.0:1787864672.541159:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844790144:12345-0@lo:503: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.541165:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864672.541205:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790144:0@lo:503: 00000100:00100000:2.0:1787864672.541346:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9919:1874711844790272:0@lo:502: 00000100:00100000:2.0:1787864672.541378:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.541401:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790272 00000100:00100000:2.0:1787864672.541404:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790272 00000100:00100000:2.0:1787864672.541423:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787864672.541429:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9919:x1874711844790272:12345-0@lo:502: 00000100:00100000:2.0:1787864672.541510:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9919:x1874711844790272:12345-0@lo:502: Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.541516:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787864672.541542:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275764513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.541552:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9919:1874711844790272:0@lo:502: 00000100:00100000:2.0:1787864672.541587:0:9919:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9919:1874711844790400:0@lo:502: 00000100:00100000:2.0:1787864672.541617:0:9919:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.541635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790400 00000100:00100000:2.0:1787864672.541638:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790400 00000100:00100000:2.0:1787864672.541657:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787864672.541662:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9919:x1874711844790400:12345-0@lo:502: 00000100:00100000:2.0:1787864672.541720:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:9919:x1874711844790400:12345-0@lo:502: Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.541727:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787864672.541760:0:9919:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275764513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.541770:0:9919:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9919:1874711844790400:0@lo:502: 00000040:00080000:2.0:1787864672.541785:0:9919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787864672.544069:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787864672.544099:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864672.544109:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.544120:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864672.544130:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787864672.544133:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787864672.544135:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787864672.544166:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.544175:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.544196:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.544216:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790528:0@lo:101: 00000100:00100000:3.0:1787864672.544272:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.544318:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.544384:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790528 00000100:00100000:0.0:1787864672.544391:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790528 00000100:00100000:0.0:1787864672.544436:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787864672.544445:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844790528:12345-0@lo:101: 00010000:00010000:0.0:1787864672.544467:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864672.544481:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc431c4 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.544502:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.544513:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.544522:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030200, rc 0) 00000100:00100000:0.0:1787864672.544565:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844790528:12345-0@lo:101: Request processed in 122us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.544571:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787864672.546633:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790528:0@lo:101: 00010000:00010000:3.0:1787864672.546657:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.546669:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.546748:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790656:0@lo:501: 00000100:00100000:3.0:1787864672.546798:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.546844:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.546962:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790656 00000100:00100000:0.0:1787864672.546979:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790656 00000100:00100000:0.0:1787864672.547019:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787864672.547028:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844790656:12345-0@lo:501: 00000100:00100000:0.0:1787864672.547141:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844790656:12345-0@lo:501: Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.547149:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787864672.547222:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790656:0@lo:501: 00000100:00100000:3.0:1787864672.547252:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790784:0@lo:503: 00000100:00100000:3.0:1787864672.547290:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.547321:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.547370:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790784 00000100:00100000:0.0:1787864672.547374:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790784 00000100:00100000:0.0:1787864672.547404:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787864672.547411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844790784:12345-0@lo:503: 00000100:00100000:0.0:1787864672.547502:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844790784:12345-0@lo:503: Request processed in 91us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.547508:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787864672.547582:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844790784:0@lo:503: 00000100:00100000:1.0:1787864672.548289:0:9920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9920:1874711844790912:0@lo:502: 00000100:00100000:1.0:1787864672.548332:0:9920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.548364:0:9920:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.548411:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844790912 00000100:00100000:0.0:1787864672.548415:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844790912 00000100:00100000:0.0:1787864672.548451:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864672.548470:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9920:x1874711844790912:12345-0@lo:502: 00000100:00100000:0.0:1787864672.548565:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9920:x1874711844790912:12345-0@lo:502: Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.548572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787864672.548683:0:9920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9920:1874711844790912:0@lo:502: 00000020:01000000:1.0:1787864672.548707:0:9920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864672.548715:0:9920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864672.548717:0:9920:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787864672.548726:0:9920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787864672.548728:0:9920:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787864672.548743:0:9920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9920:1874711844791040:0@lo:502: 00000100:00100000:1.0:1787864672.548775:0:9920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.548798:0:9920:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.548921:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791040 00000100:00100000:0.0:1787864672.548926:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791040 00000100:00100000:0.0:1787864672.548952:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787864672.548958:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9920:x1874711844791040:12345-0@lo:502: 00000100:00100000:0.0:1787864672.549032:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:9920:x1874711844791040:12345-0@lo:502: Request processed in 73us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.549038:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787864672.549120:0:9920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9920:1874711844791040:0@lo:502: 00000020:01000000:3.0:1787864672.549136:0:9920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864672.549140:0:9920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.549146:0:9920:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864672.549151:0:9920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787864672.549508:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787864672.549530:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787864672.549539:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.549549:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864672.549558:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787864672.549560:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927547df8000 from 39 10000000:01000000:0.0:1787864672.549563:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864672.549586:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.549594:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.549602:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864672.549615:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791168:0@lo:101: 00000100:00100000:0.0:1787864672.549646:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.549674:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.549717:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791168 00000100:00100000:3.0:1787864672.549722:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791168 00000100:00100000:3.0:1787864672.549751:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787864672.549758:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844791168:12345-0@lo:101: 00010000:00010000:3.0:1787864672.549767:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864672.549778:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc431d2 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.549797:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.549819:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.549828:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927582172c00, rc 0) 00000100:00100000:3.0:1787864672.549871:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791168:12345-0@lo:101: Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.549877:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787864672.550008:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791168:0@lo:101: 00010000:00010000:1.0:1787864672.550019:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.550028:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864672.550075:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791296:0@lo:501: 00000100:00100000:1.0:1787864672.550101:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.550123:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.550171:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791296 00000100:00100000:0.0:1787864672.550176:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791296 00000100:00100000:0.0:1787864672.550504:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787864672.550512:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791296:12345-0@lo:501: 00000100:00100000:0.0:1787864672.550616:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791296:12345-0@lo:501: Request processed in 105us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.550623:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787864672.552687:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791296:0@lo:501: 00000100:00100000:1.0:1787864672.552740:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791424:0@lo:503: 00000100:00100000:1.0:1787864672.552816:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.552857:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.553103:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791424 00000100:00100000:2.0:1787864672.553109:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791424 00000100:00100000:2.0:1787864672.553148:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787864672.553157:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791424:12345-0@lo:503: 00000100:00100000:2.0:1787864672.553262:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791424:12345-0@lo:503: Request processed in 106us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.553274:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787864672.553366:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791424:0@lo:503: 00000100:00100000:1.0:1787864672.553693:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9921:1874711844791552:0@lo:502: 00000100:00100000:1.0:1787864672.553729:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.553760:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.553799:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791552 00000100:00100000:2.0:1787864672.553815:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791552 00000100:00100000:2.0:1787864672.553837:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787864672.553842:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:9921:x1874711844791552:12345-0@lo:502: 00000100:00100000:2.0:1787864672.553977:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:9921:x1874711844791552:12345-0@lo:502: Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.553985:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787864672.554082:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9921:1874711844791552:0@lo:502: 00000100:00100000:1.0:1787864672.554119:0:9921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9921:1874711844791680:0@lo:502: 00000100:00100000:1.0:1787864672.554154:0:9921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.554180:0:9921:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.554348:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791680 00000100:00100000:2.0:1787864672.554352:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791680 00000100:00100000:2.0:1787864672.554372:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787864672.554377:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:9921:x1874711844791680:12345-0@lo:502: 00000100:00100000:2.0:1787864672.554477:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:9921:x1874711844791680:12345-0@lo:502: Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.554484:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787864672.554702:0:9921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9921:1874711844791680:0@lo:502: 00000040:00080000:1.0:1787864672.554728:0:9921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787864672.555142:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787864672.555164:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864672.555174:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.555190:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864672.555200:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864672.555202:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927547df8000 from 6 10000000:01000000:2.0:1787864672.555206:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864672.555233:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.555251:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.555260:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.555274:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791808:0@lo:101: 00000100:00100000:2.0:1787864672.555309:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.555370:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:1.0:1787864672.555416:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791808 00000100:00100000:1.0:1787864672.555421:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791808 00000100:00100000:1.0:1787864672.555443:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787864672.555449:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844791808:12345-0@lo:101: 00010000:00010000:1.0:1787864672.555468:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864672.555479:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948000/0x2fcb8c294dc431e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc431e0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.555498:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948000/0x2fcb8c294dc431e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc431e0 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.555507:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948000/0x2fcb8c294dc431e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431e0 expref: 19 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.555515:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948000, rc 0) 00000100:00100000:1.0:1787864672.555551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844791808:12345-0@lo:101: Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864672.555557:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787864672.555774:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791808:0@lo:101: 00010000:00010000:2.0:1787864672.555787:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.555796:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.555854:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791936:0@lo:256: 00000100:00100000:2.0:1787864672.555883:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.555933:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.555947:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844791936 00000100:00100000:2.0:1787864672.555952:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844791936 00000100:00100000:2.0:1787864672.555973:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787864672.555979:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844791936:12345-0@lo:256: 20000000:01000000:2.0:1787864672.555991:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787864672.556007:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787864672.556010:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787864672.556081:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844791936:12345-0@lo:256: Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.556093:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787864672.556118:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844791936:0@lo:256: 10000000:01000000:2.0:1787864672.556153:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864672.556158:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556165:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864672.556171:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787864672.556172:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787864672.556174:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787864672.556186:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556192:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556198:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.556207:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792064:0@lo:101: 00000100:00100000:2.0:1787864672.556227:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.556239:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.556248:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792064 00000100:00100000:2.0:1787864672.556251:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792064 00000100:00100000:2.0:1787864672.556265:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787864672.556269:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844792064:12345-0@lo:101: 00010000:00010000:2.0:1787864672.556282:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864672.556289:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc431ee expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556302:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556310:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556316:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796400, rc 0) 00000100:00100000:2.0:1787864672.556339:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844792064:12345-0@lo:101: Request processed in 70us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.556344:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787864672.556370:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792064:0@lo:101: 00010000:00010000:2.0:1787864672.556378:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.556384:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.556421:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792192:0@lo:501: 00000100:00100000:2.0:1787864672.556439:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.556449:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.556472:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792192 00000100:00100000:2.0:1787864672.556475:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792192 00000100:00100000:2.0:1787864672.556492:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787864672.556496:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844792192:12345-0@lo:501: 00000100:00100000:2.0:1787864672.556598:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844792192:12345-0@lo:501: Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.556605:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787864672.556631:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792192:0@lo:501: 00000100:00100000:2.0:1787864672.556655:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792320:0@lo:503: 00000100:00100000:2.0:1787864672.556689:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.556702:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b05240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.556711:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792320 00000100:00100000:2.0:1787864672.556715:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792320 00000100:00100000:2.0:1787864672.556731:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787864672.556736:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844792320:12345-0@lo:503: 00000100:00100000:2.0:1787864672.556804:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844792320:12345-0@lo:503: Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.556810:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787864672.556846:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844792320:0@lo:503: 00000100:00100000:2.0:1787864672.557023:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9922:1874711844792448:0@lo:502: 00000100:00100000:2.0:1787864672.557057:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.557074:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792448 00000100:00100000:2.0:1787864672.557078:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792448 00000100:00100000:2.0:1787864672.557094:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787864672.557100:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:9922:x1874711844792448:12345-0@lo:502: 00000100:00100000:2.0:1787864672.557168:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:9922:x1874711844792448:12345-0@lo:502: Request processed in 68us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.557174:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787864672.557199:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff927543053840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.557216:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9922:1874711844792448:0@lo:502: 00000020:01000000:2.0:1787864672.557236:0:9922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864672.557242:0:9922:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787864672.557247:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864672.557250:0:9922:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787864672.557256:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864672.557259:0:9922:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864672.557278:0:9922:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787864672.557281:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864672.557295:0:9922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff927446ff0000) 00000020:00000080:2.0:1787864672.557315:0:9922:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787864672.557320:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864672.557407:0:9922:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787864672.557413:0:9922:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787864672.557421:0:9922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc43203 00010000:00080000:2.0:1787864672.557445:0:9922:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9274481d5800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864672.557670:0:9922:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787864672.557788:0:9922:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787864672.557798:0:9922:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787864672.557977:0:9922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864672.558094:0:9922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864672.558220:0:9922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787864672.558306:0:9922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787864672.558588:0:9923:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000020:00000080:3.0:1787864672.559167:0:9922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787864672.559177:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787864672.559215:0:9922:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787864672.559236:0:9922:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc4320a 00000100:00080000:3.0:1787864672.559246:0:9922:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864672.559251:0:9922:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9274481d5800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864672.559280:0:9922:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558999e00 x1874711844792576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864672.559299:0:9922:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787864672.559350:0:9922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864672.559354:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.559356:0:9922:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787864672.559360:0:9922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864672.559363:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.559365:0:9922:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864672.559368:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864672.559370:0:9922:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864672.559394:0:9922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9922:1874711844792704:0@lo:502: 00000100:00100000:3.0:1787864672.559453:0:9922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.559490:0:9922:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.562724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792704 00000100:00100000:0.0:1787864672.562737:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792704 00000100:00100000:0.0:1787864672.562762:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844792832:0@lo:400: 00000100:00100000:0.0:1787864672.562834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787864672.562992:0:9923:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1787864672.563006:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844792576:0@lo:8: 00000100:00100000:2.0:1787864672.563043:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.563207:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844793344:0@lo:400: 00000100:00100000:0.0:1787864672.563232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.566530:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844793856:0@lo:400: 00000100:00100000:0.0:1787864672.566584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.566656:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792832 00000100:00100000:3.0:1787864672.566664:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792832 00000100:00100000:3.0:1787864672.566712:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793344 00000100:00100000:3.0:1787864672.566716:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793344 00000100:00100000:3.0:1787864672.566739:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864672.566747:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844792832:12345-0@lo:400: 00000100:00100000:3.0:1787864672.566800:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844792832:12345-0@lo:400: Request processed in 54us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.566818:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864672.566835:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864672.566841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844793344:12345-0@lo:400: 00000100:00100000:3.0:1787864672.566903:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844793344:12345-0@lo:400: Request processed in 46us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.566910:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787864672.568216:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc52c0 x1874711844792832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.568232:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844792832:0@lo:400: 00010000:00080000:0.0:1787864672.568245:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc6d00 x1874711844793344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.568256:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844793344:0@lo:400: 00000100:00100000:0.0:1787864672.568274:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787864672.568283:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844792960:0@lo:400: 00000100:00100000:0.0:1787864672.568321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568343:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844793472:0@lo:400: 00000100:00100000:0.0:1787864672.568364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568376:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844793984:0@lo:400: 00000100:00100000:0.0:1787864672.568397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568424:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844793088:0@lo:400: 00000100:00100000:0.0:1787864672.568446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568471:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844793600:0@lo:400: 00000100:00100000:0.0:1787864672.568506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568526:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787864672.568532:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844793216:0@lo:400: 00000100:00100000:0.0:1787864672.568552:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568567:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844793728:0@lo:400: 00000100:00100000:0.0:1787864672.568587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.568617:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792576 00000100:00100000:0.0:1787864672.568622:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792576 00000100:00100000:0.0:1787864672.568647:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793600 00000100:00100000:0.0:1787864672.568650:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793600 00000100:00100000:0.0:1787864672.568667:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793728 00000100:00100000:0.0:1787864672.568668:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793728 00000100:00100000:0.0:1787864672.568681:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864672.568688:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844793600:12345-0@lo:400: 00000100:00100000:0.0:1787864672.568730:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844793600:12345-0@lo:400: Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.568736:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864672.568750:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864672.568757:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844793728:12345-0@lo:400: 00000100:00100000:0.0:1787864672.568782:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844793728:12345-0@lo:400: Request processed in 26us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.568787:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864672.568798:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864672.568801:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1874711844792576:12345-0@lo:8: 00010000:00080000:0.0:1787864672.568823:0:8425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1787864672.568847:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc43211 00002000:00100000:0.0:1787864672.568860:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff927447eab000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787864672.568869:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1787864672.568873:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787864672.568956:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787864672.569160:0:8425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787864672.569182:0:8425:0:(import.c:65:import_set_state_nolock()) ffff927447ea9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864672.569220:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844792576:12345-0@lo:8: Request processed in 417us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569226:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864672.569245:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793856 00000100:00100000:0.0:1787864672.569249:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793856 00000100:00100000:0.0:1787864672.569264:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793472 00000100:00100000:0.0:1787864672.569266:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793472 00000100:00100000:0.0:1787864672.569275:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793984 00000100:00100000:0.0:1787864672.569277:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793984 00000100:00100000:0.0:1787864672.569285:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793088 00000100:00100000:0.0:1787864672.569287:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793088 00000100:00100000:0.0:1787864672.569297:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864672.569302:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844793856:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569335:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844793856:12345-0@lo:400: Request processed in 33us (2751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569341:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864672.569352:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864672.569357:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844793472:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569383:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844793472:12345-0@lo:400: Request processed in 26us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569388:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864672.569398:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864672.569403:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844793984:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569435:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844793984:12345-0@lo:400: Request processed in 33us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569440:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864672.569451:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864672.569468:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844793088:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569491:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844793088:12345-0@lo:400: Request processed in 36us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569496:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864672.569517:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844792960 00000100:00100000:0.0:1787864672.569521:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844792960 00000100:00100000:0.0:1787864672.569541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844793216 00000100:00100000:0.0:1787864672.569544:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844793216 00000100:00100000:0.0:1787864672.569555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864672.569561:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844792960:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569592:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844792960:12345-0@lo:400: Request processed in 30us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569598:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864672.569609:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864672.569615:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844793216:12345-0@lo:400: 00000100:00100000:0.0:1787864672.569638:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844793216:12345-0@lo:400: Request processed in 24us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.569643:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864672.569682:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844793216:0@lo:400: 00010000:00080000:0.0:1787864672.569694:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274481852c0 x1874711844793728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569703:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844793728:0@lo:400: 00010000:00080000:0.0:1787864672.569722:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc4b40 x1874711844793088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569730:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844793088:0@lo:400: 00010000:00080000:0.0:1787864672.569740:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc6580 x1874711844793600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569748:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844793600:0@lo:400: 00010000:00080000:0.0:1787864672.569802:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558999e00 x1874711844792576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569810:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864672.569816:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787864672.569822:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787864672.569827:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787864672.569830:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9274481d5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787864672.569844:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787864672.569848:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844792576:0@lo:8: 00000100:00100000:0.0:1787864672.569876:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844792960:0@lo:400: 00010000:00080000:0.0:1787864672.569908:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc70c0 x1874711844793472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569918:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844793472:0@lo:400: 00010000:00080000:0.0:1787864672.569929:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448184780 x1874711844793984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569936:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844793984:0@lo:400: 00010000:00080000:0.0:1787864672.569945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448184f00 x1874711844793856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.569959:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844793856:0@lo:400: 00000100:00100000:0.0:1787864672.570273:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787864672.570280:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:9922:x1874711844792704:12345-0@lo:502: 00000100:00100000:0.0:1787864672.570381:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:9922:x1874711844792704:12345-0@lo:502: Request processed in 101us (10928us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.570388:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000004:00080000:2.0:1787864672.571810:0:9923:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787864672.571875:0:9923:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 197633985916ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787864672.571884:0:9923:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787864672.571962:0:9922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9922:1874711844792704:0@lo:502: 00000020:01000000:1.0:1787864672.572002:0:9922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864672.572009:0:9922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864672.572011:0:9922:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787864672.572017:0:9922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:1.0:1787864672.572159:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844794112:0@lo:700: 00000100:00100000:1.0:1787864672.572211:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.572234:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754c45b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.572361:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794112 00000100:00100000:0.0:1787864672.572366:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794112 00000100:00100000:0.0:1787864672.572411:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864672.572420:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9924:x1874711844794112:12345-0@lo:700: 00000100:00100000:0.0:1787864672.572451:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1874711844794240:0@lo:700: 00000100:00100000:0.0:1787864672.572490:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.572507:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e450c0 going to sleep for 11 seconds 00000100:00080000:0.0:1787864672.572518:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864672.572530:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794240 00000100:00100000:0.0:1787864672.572533:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794240 00000100:00100000:0.0:1787864672.572559:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864672.572566:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1874711844794240:12345-0@lo:700: 00000020:01000000:2.0:1787864672.572927:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1787864672.572949:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787864672.572959:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.572970:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864672.572978:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787864672.572981:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927548600000 from 39 10000000:01000000:2.0:1787864672.572983:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864672.573007:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.573015:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.573024:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.573038:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794368:0@lo:101: 00000100:00100000:2.0:1787864672.573069:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.573098:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.573166:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794368 00000100:00100000:0.0:1787864672.573170:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794368 00000100:00100000:0.0:1787864672.573203:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787864672.573210:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844794368:12345-0@lo:101: 00010000:00010000:0.0:1787864672.573219:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864672.573230:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43218 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.573263:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.573273:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.573281:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031400, rc 0) 00000100:00100000:0.0:1787864672.573314:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844794368:12345-0@lo:101: Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.573320:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787864672.573618:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794368:0@lo:101: 00010000:00010000:0.0:1787864672.573632:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864672.573641:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864672.573693:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794496:0@lo:501: 00000100:00100000:0.0:1787864672.573718:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.573733:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.573747:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794496 00000100:00100000:0.0:1787864672.573750:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794496 00000100:00100000:0.0:1787864672.573777:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787864672.573783:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844794496:12345-0@lo:501: 00000100:00100000:0.0:1787864672.573880:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844794496:12345-0@lo:501: Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.573910:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787864672.573953:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794496:0@lo:501: 00000100:00100000:0.0:1787864672.573982:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794624:0@lo:503: 00000100:00100000:0.0:1787864672.574076:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.574089:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864672.574168:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794624 00000100:00100000:0.0:1787864672.574171:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794624 00000100:00100000:0.0:1787864672.574189:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787864672.574195:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844794624:12345-0@lo:503: 00000100:00100000:0.0:1787864672.574263:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844794624:12345-0@lo:503: Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.574269:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787864672.574306:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844794624:0@lo:503: 00000100:00100000:0.0:1787864672.575442:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9926:1874711844794752:0@lo:502: 00000100:00100000:0.0:1787864672.575502:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.575528:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.575648:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794752 00000100:00100000:3.0:1787864672.575654:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794752 00000100:00100000:3.0:1787864672.575688:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787864672.575696:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:9926:x1874711844794752:12345-0@lo:502: 00000100:00100000:3.0:1787864672.575804:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:9926:x1874711844794752:12345-0@lo:502: Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.575812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787864672.575857:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9926:1874711844794752:0@lo:502: 00000100:00100000:3.0:1787864672.575931:0:9926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9926:1874711844794880:0@lo:502: 00000100:00100000:3.0:1787864672.575964:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.575986:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844794880 00000100:00100000:3.0:1787864672.575989:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844794880 00000100:00100000:3.0:1787864672.576006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787864672.576011:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:9926:x1874711844794880:12345-0@lo:502: 00000100:00100000:3.0:1787864672.576069:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:9926:x1874711844794880:12345-0@lo:502: Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.576076:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787864672.576105:0:9926:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.576117:0:9926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9926:1874711844794880:0@lo:502: 00000040:00080000:3.0:1787864672.576133:0:9926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787864672.576181:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787864672.576199:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864672.576206:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576215:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864672.576223:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787864672.576226:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff927548600000 from 6 10000000:01000000:3.0:1787864672.576228:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787864672.576252:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576258:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576266:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.576276:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795008:0@lo:101: 00000100:00100000:3.0:1787864672.576300:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.576313:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.576323:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795008 00000100:00100000:3.0:1787864672.576326:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795008 00000100:00100000:3.0:1787864672.576345:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787864672.576351:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844795008:12345-0@lo:101: 00010000:00010000:3.0:1787864672.576358:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864672.576369:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927582173000/0x2fcb8c294dc4322d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43226 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576386:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927582173000/0x2fcb8c294dc4322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43226 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576395:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927582173000/0x2fcb8c294dc4322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43226 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576403:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927582173000, rc 0) 00000100:00100000:3.0:1787864672.576428:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844795008:12345-0@lo:101: Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.576434:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787864672.576483:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795008:0@lo:101: 00010000:00010000:3.0:1787864672.576493:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576502:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.576539:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795136:0@lo:256: 00000100:00100000:3.0:1787864672.576566:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.576579:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.576589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795136 00000100:00100000:3.0:1787864672.576591:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795136 00000100:00100000:3.0:1787864672.576613:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787864672.576618:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844795136:12345-0@lo:256: 20000000:01000000:3.0:1787864672.576630:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787864672.576644:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787864672.576647:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787864672.576717:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844795136:12345-0@lo:256: Request processed in 99us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.576724:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787864672.576754:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795136:0@lo:256: 10000000:01000000:3.0:1787864672.576790:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787864672.576795:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576802:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864672.576816:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787864672.576817:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787864672.576819:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787864672.576843:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576851:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576859:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.576870:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795264:0@lo:101: 00000100:00100000:3.0:1787864672.576914:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.576929:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.576940:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795264 00000100:00100000:3.0:1787864672.576943:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795264 00000100:00100000:3.0:1787864672.576967:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787864672.576972:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844795264:12345-0@lo:101: 00010000:00010000:3.0:1787864672.576978:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864672.576987:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43234 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.576999:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.577007:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.577023:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f800, rc 0) 00000100:00100000:3.0:1787864672.577054:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844795264:12345-0@lo:101: Request processed in 81us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.577060:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787864672.577087:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795264:0@lo:101: 00010000:00010000:3.0:1787864672.577096:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864672.577103:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864672.577142:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795392:0@lo:501: 00000100:00100000:3.0:1787864672.577164:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.577176:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.577185:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795392 00000100:00100000:3.0:1787864672.577188:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795392 00000100:00100000:3.0:1787864672.577202:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787864672.577207:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844795392:12345-0@lo:501: 00000100:00100000:3.0:1787864672.577291:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844795392:12345-0@lo:501: Request processed in 84us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.577297:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787864672.577321:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795392:0@lo:501: 00000100:00100000:3.0:1787864672.577343:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795520:0@lo:503: 00000100:00100000:3.0:1787864672.577375:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.577387:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.577401:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795520 00000100:00100000:3.0:1787864672.577405:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795520 00000100:00100000:3.0:1787864672.577420:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787864672.577426:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844795520:12345-0@lo:503: 00000100:00100000:3.0:1787864672.577503:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844795520:12345-0@lo:503: Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.577509:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787864672.577542:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844795520:0@lo:503: 00000004:00080000:0.0:1787864672.579316:0:7441:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787864672.580479:0:9927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9927:1874711844795648:0@lo:502: 00000100:00100000:0.0:1787864672.580555:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.580592:0:9927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.580665:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795648 00000100:00100000:3.0:1787864672.580672:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795648 00000100:00100000:3.0:1787864672.580722:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787864672.580731:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:9927:x1874711844795648:12345-0@lo:502: 00000100:00100000:3.0:1787864672.580852:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:9927:x1874711844795648:12345-0@lo:502: Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.580860:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787864672.581111:0:9927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9927:1874711844795648:0@lo:502: 00000020:01000000:2.0:1787864672.581142:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864672.581149:0:9927:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787864672.581157:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864672.581159:0:9927:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787864672.581165:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864672.581168:0:9927:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864672.581194:0:9927:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787864672.581197:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864672.581219:0:9927:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff927448291a48) 00000020:00000080:2.0:1787864672.581240:0:9927:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787864672.581246:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864672.581317:0:9927:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787864672.581322:0:9927:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787864672.581336:0:9927:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc43249 00010000:00080000:2.0:1787864672.581361:0:9927:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927448229000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864672.581576:0:9927:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787864672.581694:0:9927:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787864672.581704:0:9927:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787864672.581851:0:9927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864672.581985:0:9927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864672.582104:0:9927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787864672.582197:0:9927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 40000000:02000000:2.0:1787864672.582768:0:6517:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1787864672.592791:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558998780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8433:x1874711844794240:12345-0@lo:700: Request processed in 20217us (20291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.592816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787864672.592872:0:8433:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558996580 x1874711844794240/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864672.592911:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8433:1874711844794240:0@lo:700: 40000000:02000000:2.0:1787864672.592925:0:8433:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1787864672.593939:0:9928:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864672.593945:0:9928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:1.0:1787864672.606623:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787864672.606850:0:9927:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787864672.606863:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787864672.607741:0:9927:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787864672.607768:0:9927:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc43250 00000100:00080000:3.0:1787864672.607779:0:9927:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864672.607785:0:9927:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927448229000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864672.607817:0:9927:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448187c00 x1874711844795776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864672.607852:0:9927:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787864672.607946:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864672.607952:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.607953:0:9927:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000100:00100000:1.0:1787864672.608377:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844795776:0@lo:8: 00000100:00100000:1.0:1787864672.608439:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787864672.608801:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864672.608838:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.608840:0:9927:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864672.608844:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864672.608846:0:9927:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787864672.608874:0:9927:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9927:1874711844795904:0@lo:502: 00000100:00100000:0.0:1787864672.609058:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795776 00000100:00100000:0.0:1787864672.609065:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795776 00000100:00100000:0.0:1787864672.609099:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864672.609105:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1874711844795776:12345-0@lo:8: 00010000:00080000:0.0:1787864672.609129:0:8425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1787864672.609159:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc43257 00002000:00100000:0.0:1787864672.609170:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff927447eab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787864672.609174:0:8425:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787864672.609176:0:8425:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787864672.609235:0:8425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787864672.609255:0:8425:0:(import.c:65:import_set_state_nolock()) ffff927447eae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864672.609303:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844795776:12345-0@lo:8: Request processed in 197us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.609310:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864672.609398:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.609426:0:9927:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482830c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787864672.609766:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448187c00 x1874711844795776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864672.609777:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864672.609783:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787864672.609789:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787864672.609794:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787864672.609796:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787864672.609809:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787864672.609814:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844795776:0@lo:8: 00000004:00080000:1.0:1787864672.609838:0:9928:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787864672.609913:0:9928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 197672023811ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787864672.609919:0:9928:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1787864672.610785:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844795904 00000100:00100000:0.0:1787864672.610793:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844795904 00000100:00100000:0.0:1787864672.610833:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787864672.610841:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:9927:x1874711844795904:12345-0@lo:502: 00000100:00100000:0.0:1787864672.611707:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:9927:x1874711844795904:12345-0@lo:502: Request processed in 864us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.611718:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000001:00100000:0.0:1787864672.612114:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787864672.612277:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844794112:12345-0@lo:700: Request processed in 39857us (40064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864672.612291:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864672.612510:0:9927:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:9927:1874711844795904:0@lo:502: 00000020:01000000:3.0:1787864672.612541:0:9927:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864672.612548:0:9927:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864672.612550:0:9927:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787864672.612555:0:9927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1787864672.612871:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1787864672.612923:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787864672.612934:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.612957:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864672.612978:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787864672.612980:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92755ed9ced8 from 1 10000000:01000000:2.0:1787864672.612984:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787864672.613014:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.613022:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864672.613032:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864672.613049:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844796032:0@lo:101: 00000100:00100000:2.0:1787864672.613083:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.613113:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70600 going to sleep for 11 seconds 00000100:00100000:1.0:1787864672.613234:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796032 00000100:00100000:1.0:1787864672.613239:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796032 00000100:00100000:1.0:1787864672.613290:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787864672.613299:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844796032:12345-0@lo:101: 00010000:00010000:1.0:1787864672.613310:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864672.613321:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4325e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.613342:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.613352:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.613360:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949a00, rc 0) 00000100:00100000:1.0:1787864672.613394:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844796032:12345-0@lo:101: Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864672.613401:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787864672.613436:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844796032:0@lo:101: 00010000:00010000:1.0:1787864672.613447:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.613467:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864672.613519:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844796160:0@lo:501: 00000100:00100000:1.0:1787864672.613541:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.613555:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547a5b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864672.613567:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796160 00000100:00100000:1.0:1787864672.613570:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796160 00000100:00100000:1.0:1787864672.613594:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787864672.613606:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844796160:12345-0@lo:501: 00000100:00100000:1.0:1787864672.613671:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844796160:12345-0@lo:501: Request processed in 66us (129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864672.613678:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787864672.613705:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844796160:0@lo:501: 10000000:01000000:1.0:1787864672.613727:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787864672.613732:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864672.613740:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864672.617190:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787864672.617341:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864672.617359:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844796288:0@lo:13: 00000100:00100000:1.0:1787864672.617414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787864672.617452:0:9930:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787864672.617482:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796416:0@lo:7: 00000100:00100000:1.0:1787864672.617504:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.617528:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796416 00000100:00100000:1.0:1787864672.617533:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796416 00000100:00100000:1.0:1787864672.617580:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864672.617587:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9930:x1874711844796416:12345-0@lo:7: 00000100:00100000:2.0:1787864672.618981:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796288 00000100:00100000:2.0:1787864672.618989:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796288 00000100:00100000:2.0:1787864672.619030:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864672.619038:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874711844796288:12345-0@lo:13: 00002000:00000024:2.0:1787864672.619060:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:2.0:1787864672.619122:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874711844796288:12345-0@lo:13: Request processed in 85us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.619129:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787864672.619776:0:9924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c7480 x1874711844794112/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.619790:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844794112:0@lo:700: 00000100:00080000:2.0:1787864672.619927:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864672.619946:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715b540 going to sleep for 11 seconds 00010000:00080000:0.0:1787864672.623129:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c5680 x1874711844796288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.623156:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844796288:0@lo:13: 00000100:00100000:2.0:1787864672.627522:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:1.0:1787864672.628767:0:8820:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787864672.628774:0:8820:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787864672.628869:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9930:x1874711844796416:12345-0@lo:7: Request processed in 11279us (11360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864672.628880:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787864672.628962:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c4000 x1874711844796416/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864672.628977:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796416:0@lo:7: 00000004:00080000:1.0:1787864672.628992:0:9930:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787864672.629023:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796672:0@lo:5: 00000100:00100000:1.0:1787864672.629055:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.629086:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796672 00000100:00100000:1.0:1787864672.629091:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796672 00000100:00100000:1.0:1787864672.629126:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864672.629135:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9930:x1874711844796672:12345-0@lo:5: 00002000:00080000:1.0:1787864672.629156:0:8425:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787864672.629160:0:8425:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787864672.629805:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744715b540 going to sleep for 11 seconds 00000004:00080000:0.0:1787864672.629979:0:9924:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787864672.630005:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844796800:0@lo:7: 00000100:00100000:0.0:1787864672.630054:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.630086:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864672.631757:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796800 00000100:00100000:1.0:1787864672.631769:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796800 00000100:00100000:1.0:1787864672.631814:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864672.631825:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844796800:12345-0@lo:7: 00000001:00080000:0.0:1787864672.634796:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787864672.634811:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787864672.637269:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9930:x1874711844796672:12345-0@lo:5: Request processed in 8130us (8208us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787864672.637282:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864672.637387:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844796544:0@lo:13: 00000100:00100000:2.0:1787864672.637427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864672.637486:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796544 00000100:00100000:2.0:1787864672.637493:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796544 00000100:00100000:2.0:1787864672.637537:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864672.637545:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874711844796544:12345-0@lo:13: 00002000:00000024:2.0:1787864672.637566:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923914752 avail 3692392448 00000100:00100000:2.0:1787864672.637601:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874711844796544:12345-0@lo:13: Request processed in 57us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864672.637608:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787864672.637750:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558999e00 x1874711844796544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864672.637769:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844796544:0@lo:13: 00010000:00080000:0.0:1787864672.638001:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c4000 x1874711844796672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.638009:0:9930:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787864672.638013:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796672:0@lo:5: 00000004:00080000:0.0:1787864672.638025:0:9930:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787864672.638057:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796928:0@lo:700: 00000100:00100000:0.0:1787864672.638081:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.638104:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864672.638218:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844796928 00000100:00100000:2.0:1787864672.638223:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844796928 00000100:00100000:2.0:1787864672.638256:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864672.638263:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9930:x1874711844796928:12345-0@lo:700: 00002000:00080000:1.0:1787864672.643055:0:8426:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787864672.643064:0:8426:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1787864672.643150:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844796800:12345-0@lo:7: Request processed in 11324us (13092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864672.643161:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787864672.643471:0:9924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc70c0 x1874711844796800/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.643488:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844796800:0@lo:7: 00000004:00080000:0.0:1787864672.643503:0:9924:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787864672.643538:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844797056:0@lo:5: 00000100:00100000:0.0:1787864672.643574:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864672.643606:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471e5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864672.643707:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797056 00000100:00100000:3.0:1787864672.643713:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797056 00000100:00100000:3.0:1787864672.643758:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864672.643767:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844797056:12345-0@lo:5: 00002000:00080000:3.0:1787864672.643790:0:8423:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787864672.643831:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844797056:12345-0@lo:5: Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.643837:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787864672.643869:0:9924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc70c0 x1874711844797056/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864672.643879:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc70c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844797056:0@lo:5: 00000004:00080000:3.0:1787864672.643908:0:9924:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787864672.643933:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844797184:0@lo:5: 00000100:00100000:3.0:1787864672.643956:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.644001:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797184 00000100:00100000:3.0:1787864672.644005:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797184 00000100:00100000:3.0:1787864672.644025:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864672.644031:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9924:x1874711844797184:12345-0@lo:5: 00002000:00080000:3.0:1787864672.644052:0:8425:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1787864672.645659:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9924:x1874711844797184:12345-0@lo:5: Request processed in 1623us (1697us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787864672.645671:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864672.645748:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482830c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787864672.645770:0:9924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448187480 x1874711844797184/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864672.645785:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9924:1874711844797184:0@lo:5: 00000004:00080000:3.0:1787864672.645796:0:9924:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787864672.645826:0:9924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9924:1874711844797312:0@lo:900: 00000100:00100000:3.0:1787864672.645856:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864672.645918:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797312 00000100:00100000:3.0:1787864672.645923:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797312 00000100:00100000:3.0:1787864672.645958:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864672.645966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9924:x1874711844797312:12345-0@lo:900: 00000100:00100000:3.0:1787864672.646004:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9924:x1874711844797312:12345-0@lo:900: Request processed in 40us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864672.646010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864672.646026:0:9924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482830c0 going to sleep for 11 seconds 00010000:00080000:3.0:1787864672.646038:0:9924:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274481843c0 x1874711844797312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864672.646047:0:9924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9924:1874711844797312:0@lo:900: 00000001:00080000:2.0:1787864672.668565:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787864672.668830:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9930:x1874711844796928:12345-0@lo:700: Request processed in 30563us (30743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864672.668843:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787864672.670754:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc6580 x1874711844796928/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864672.670772:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844796928:0@lo:700: 00000004:02000040:2.0:1787864672.672121:0:9930:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:1.0:1787864672.684071:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844797440:0@lo:5: 00000100:00100000:1.0:1787864672.684138:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864672.684176:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797440 00000100:00100000:1.0:1787864672.684183:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797440 00000100:00100000:1.0:1787864672.684228:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864672.684238:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9930:x1874711844797440:12345-0@lo:5: 00000100:00100000:0.0:1787864672.690570:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7a80 going to sleep for 11 seconds 00002000:00080000:1.0:1787864672.699200:0:8423:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787864672.699220:0:8423:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787864672.701016:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9930:x1874711844797440:12345-0@lo:5: Request processed in 16773us (16871us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787864672.701028:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787864672.704689:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c4000 x1874711844797440/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787864688 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864672.704708:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9930:1874711844797440:0@lo:5: 00000004:00080000:0.0:1787864672.704722:0:9930:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:00080000:2.0:1787864673.320290:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787864673.563136:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864673.563161:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844797568:0@lo:41: 00000100:00100000:1.0:1787864673.563225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864673.563293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797568 00000100:00100000:0.0:1787864673.563301:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797568 00000100:00100000:0.0:1787864673.563360:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787864673.563368:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844797568:12345-0@lo:41: 00000004:00000024:0.0:1787864673.563399:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864673.563459:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844797568:12345-0@lo:41: Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864673.563466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787864673.563593:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844797568:0@lo:41: 00010000:00010000:2.0:1787864673.625273:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864674.075535:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864674.075556:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864674.075561:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844797824:0@lo:13: 00000100:00100000:2.0:1787864674.075582:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844797696:0@lo:13: 00000100:00100000:0.0:1787864674.075637:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864674.075726:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797824 00000100:00100000:3.0:1787864674.075734:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797824 00000100:00100000:3.0:1787864674.075796:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787864674.075816:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844797824:12345-0@lo:13: 00002000:00000024:3.0:1787864674.075853:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864674.075937:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844797824:12345-0@lo:13: Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864674.075945:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864674.075970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864674.076057:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787864674.076353:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc6580 x1874711844797824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864674.076372:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844797824:0@lo:13: 00000100:00100000:3.0:1787864674.078536:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797696 00000100:00100000:3.0:1787864674.078546:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797696 00000100:00100000:3.0:1787864674.078625:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787864674.078634:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844797696:12345-0@lo:13: 00002000:00000024:3.0:1787864674.078656:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864674.078729:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844797696:12345-0@lo:13: Request processed in 96us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864674.078736:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787864674.078976:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448186d00 x1874711844797696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787864674.078978:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864674.079009:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844797696:0@lo:13: 00010000:00010000:1.0:1787864674.649034:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864675.102375:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864675.102396:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844797952:0@lo:41: 00000100:00100000:0.0:1787864675.102470:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864675.102540:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844797952 00000100:00100000:0.0:1787864675.102553:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844797952 00000100:00100000:0.0:1787864675.102595:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787864675.102604:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844797952:12345-0@lo:41: 00000004:00000024:1.0:1787864675.107511:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787864675.107603:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844797952:12345-0@lo:41: Request processed in 4997us (5130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864675.107826:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844797952:0@lo:41: 00000100:00100000:1.0:1787864675.107912:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000020:00000004:3.0:1787864675.224432:0:10027:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864675.224673:0:10027:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864675.673097:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787864676.170113:0:10075:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864676.170123:0:10075:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1787864676.598721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.599137:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875072 00000100:00100000:1.0:1787864676.599151:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875072 00000100:00100000:0.0:1787864676.599568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:0.0:1787864676.599579:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1874711825875072:12345-192.168.206.36@tcp:250: 00010000:00080000:0.0:1787864676.599615:0:6503:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from bf3a6481-6bff-4a6c-ac5c-f5134d1da809@192.168.206.36@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1787864676.599665:0:6503:0:(genops.c:1385:class_connect()) connect: client bf3a6481-6bff-4a6c-ac5c-f5134d1da809, cookie 0x2fcb8c294dc4326c 00000100:00080000:0.0:1787864676.599868:0:6503:0:(import.c:65:import_set_state_nolock()) ffff927447eaf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864676.600141:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+5:2406:x1874711825875072:12345-192.168.206.36@tcp:250: Request processed in 560us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864676.600151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:1.0:1787864676.607833:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.608635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875200 00000100:00100000:2.0:1787864676.608648:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875200 00000100:00100000:0.0:1787864676.618520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00100000:0.0:1787864676.618535:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+5:6185:x1874711825875200:12345-192.168.206.36@tcp:101: 00010000:00010000:0.0:1787864676.618553:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864676.618572:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac7cd expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.618598:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.618609:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.618617:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:0.0:1787864676.618771:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+6:6185:x1874711825875200:12345-192.168.206.36@tcp:101: Request processed in 239us (10951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864676.618793:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00100000:0.0:1787864676.622852:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.623418:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875328 00000100:00100000:2.0:1787864676.623504:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875328 00000100:00100000:2.0:1787864676.623579:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00100000:2.0:1787864676.623591:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+6:6185:x1874711825875328:12345-192.168.206.36@tcp:501: 00000100:00100000:2.0:1787864676.624136:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+6:6185:x1874711825875328:12345-192.168.206.36@tcp:501: Request processed in 545us (1295us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864676.624163:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00100000:2.0:1787864676.631626:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864676.631750:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875456 00000100:00100000:0.0:1787864676.631766:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875456 00000100:00100000:0.0:1787864676.631862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 183 00000100:00100000:0.0:1787864676.631875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+6:6185:x1874711825875456:12345-192.168.206.36@tcp:101: 00010000:00010000:0.0:1787864676.631934:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864676.631973:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac7d4 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.632011:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.632025:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864676.632037:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030e00, rc 0) 00000100:00100000:0.0:1787864676.632114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+7:6185:x1874711825875456:12345-192.168.206.36@tcp:101: Request processed in 241us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864676.632123:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 183 00000100:00100000:1.0:1787864676.635983:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.636100:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875584 00000100:00100000:2.0:1787864676.636114:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875584 00000100:00100000:2.0:1787864676.636177:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 184 00000100:00100000:2.0:1787864676.636188:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+7:6185:x1874711825875584:12345-192.168.206.36@tcp:501: 00000100:00100000:2.0:1787864676.636367:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6185:x1874711825875584:12345-192.168.206.36@tcp:501: Request processed in 180us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.636376:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 184 00000100:00100000:2.0:1787864676.641987:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.642121:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875712 00000100:00100000:1.0:1787864676.642130:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875712 00000100:00100000:1.0:1787864676.642180:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 185 00000100:00100000:1.0:1787864676.642189:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6185:x1874711825875712:12345-192.168.206.36@tcp:503: 00000100:00100000:1.0:1787864676.643470:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6185:x1874711825875712:12345-192.168.206.36@tcp:503: Request processed in 1275us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864676.643481:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 185 00000100:00100000:3.0:1787864676.656501:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.657238:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875840 00000100:00100000:2.0:1787864676.657252:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875840 00000100:00100000:2.0:1787864676.657325:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 186 00000100:00100000:2.0:1787864676.657336:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6204:x1874711825875840:12345-192.168.206.36@tcp:502: 00000100:00100000:2.0:1787864676.657523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6204:x1874711825875840:12345-192.168.206.36@tcp:502: Request processed in 188us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.657531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 186 00000100:00100000:2.0:1787864676.692516:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.692621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825875968 00000100:00100000:1.0:1787864676.692630:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825875968 00000100:00100000:1.0:1787864676.692681:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 187 00000100:00100000:1.0:1787864676.692691:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6204:x1874711825875968:12345-192.168.206.36@tcp:502: 00000100:00100000:1.0:1787864676.692842:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6204:x1874711825875968:12345-192.168.206.36@tcp:502: Request processed in 152us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864676.692850:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 187 00000100:00100000:0.0:1787864676.699267:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.699350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876096 00000100:00100000:1.0:1787864676.699363:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876096 00000100:00100000:1.0:1787864676.699427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 188 00000100:00100000:1.0:1787864676.699449:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6185:x1874711825876096:12345-192.168.206.36@tcp:101: 00010000:00010000:1.0:1787864676.699464:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864676.699481:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948200/0x2fcb8c294dc43281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac805 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.699506:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948200/0x2fcb8c294dc43281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac805 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.699517:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948200/0x2fcb8c294dc43281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac805 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.699525:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948200, rc 0) 00000100:00100000:1.0:1787864676.699590:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6185:x1874711825876096:12345-192.168.206.36@tcp:101: Request processed in 155us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864676.700142:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 188 00010000:00010000:2.0:1787864676.700316:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864676.709343:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.709454:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876224 00000100:00100000:2.0:1787864676.709463:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876224 00000100:00100000:2.0:1787864676.709517:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:2.0:1787864676.709526:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6185:x1874711825876224:12345-192.168.206.36@tcp:256: 20000000:01000000:2.0:1787864676.709549:0:6503:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787864676.709572:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787864676.709576:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787864676.709579:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787864676.709582:0:6503:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787864676.709584:0:6503:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1787864676.718773:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6185:x1874711825876224:12345-192.168.206.36@tcp:256: Request processed in 9238us (9427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.718788:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:0.0:1787864676.725210:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.725307:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876352 00000100:00100000:1.0:1787864676.725315:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876352 00000100:00100000:1.0:1787864676.725371:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:1.0:1787864676.725393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6185:x1874711825876352:12345-192.168.206.36@tcp:101: 00010000:00010000:1.0:1787864676.725409:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864676.725424:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac80c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.725461:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.725472:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864676.725481:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949200, rc 0) 00000100:00100000:1.0:1787864676.725954:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6185:x1874711825876352:12345-192.168.206.36@tcp:101: Request processed in 554us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864676.725962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:3.0:1787864676.728648:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.728721:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876480 00000100:00100000:2.0:1787864676.728729:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876480 00000100:00100000:2.0:1787864676.728828:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:2.0:1787864676.728839:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6185:x1874711825876480:12345-192.168.206.36@tcp:501: 00000100:00100000:2.0:1787864676.729031:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6185:x1874711825876480:12345-192.168.206.36@tcp:501: Request processed in 194us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.729039:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:3.0:1787864676.731846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864676.732588:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876608 00000100:00100000:1.0:1787864676.732884:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876608 00000100:00100000:1.0:1787864676.733664:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:1.0:1787864676.733680:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6185:x1874711825876608:12345-192.168.206.36@tcp:503: 00000100:00100000:1.0:1787864676.733883:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6185:x1874711825876608:12345-192.168.206.36@tcp:503: Request processed in 208us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864676.733914:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:0.0:1787864676.741659:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864676.743236:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876736 00000100:00100000:2.0:1787864676.743248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876736 00000100:00100000:2.0:1787864676.743313:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 193 00000100:00100000:2.0:1787864676.743321:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6210:x1874711825876736:12345-192.168.206.36@tcp:502: 00000100:00100000:2.0:1787864676.743847:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6210:x1874711825876736:12345-192.168.206.36@tcp:502: Request processed in 524us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.743856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 193 00000100:00100000:3.0:1787864676.753668:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864676.753926:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876864 00000100:00100000:0.0:1787864676.753935:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876864 00000100:00100000:0.0:1787864676.754003:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 194 00000100:00100000:0.0:1787864676.754013:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6210:x1874711825876864:12345-192.168.206.36@tcp:502: 00000100:00100000:0.0:1787864676.754165:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6210:x1874711825876864:12345-192.168.206.36@tcp:502: Request processed in 153us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864676.754173:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 194 00000100:00100000:2.0:1787864676.764548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864676.764714:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825876992 00000100:00100000:0.0:1787864676.764723:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825876992 00000100:00100000:0.0:1787864676.764811:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864676.764819:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1874711825876992:12345-192.168.206.36@tcp:38: 00010000:00080000:0.0:1787864676.764845:0:6510:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 201 last 0 00000100:00100000:3.0:1787864676.764940:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000020:00000080:0.0:1787864676.764953:0:6510:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc4328f 00000004:00100000:0.0:1787864676.764978:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 77 00000100:00080000:0.0:1787864676.765197:0:6510:0:(import.c:65:import_set_state_nolock()) ffff927447eae000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864676.765274:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825876992:12345-192.168.206.36@tcp:38: Request processed in 454us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864676.765283:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:2.0:1787864676.769979:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877248 00000100:00100000:2.0:1787864676.769992:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877248 00000100:00100000:2.0:1787864676.770053:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:2.0:1787864676.770061:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1874711825877248:12345-192.168.206.36@tcp:38: 00010000:00080000:2.0:1787864676.770090:0:8448:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1787864676.770135:0:8448:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc43296 00000004:00100000:2.0:1787864676.770160:0:8448:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 77 00000100:00080000:2.0:1787864676.770470:0:8448:0:(import.c:65:import_set_state_nolock()) ffff92744822a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864676.770532:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825877248:12345-192.168.206.36@tcp:38: Request processed in 469us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864676.770540:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:1.0:1787864677.531269:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864677.531387:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877376 00000100:00100000:2.0:1787864677.531396:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877376 00000100:00100000:2.0:1787864677.531491:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:2.0:1787864677.531501:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825877376:12345-192.168.206.36@tcp:41: 00000004:00000024:2.0:1787864677.531536:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787864677.531603:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825877376:12345-192.168.206.36@tcp:41: Request processed in 104us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.531612:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:2.0:1787864677.532313:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864677.532370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864677.532453:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877504 00000100:00100000:3.0:1787864677.532458:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877504 00000100:00100000:3.0:1787864677.532502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877120 00000100:00100000:3.0:1787864677.532505:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877120 00000100:00100000:3.0:1787864677.532537:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864677.532544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:6185:x1874711825877504:12345-192.168.206.36@tcp:41: 00000004:00000024:3.0:1787864677.532568:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787864677.532622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:6185:x1874711825877504:12345-192.168.206.36@tcp:41: Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864677.532628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864677.532643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864677.532650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825877120:12345-192.168.206.36@tcp:41: 00000004:00000024:3.0:1787864677.532662:0:6512:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787864677.532682:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825877120:12345-192.168.206.36@tcp:41: Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864677.532688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00080000:1.0:1787864677.533247:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864677.533253:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864677.536982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864677.537066:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877632 00000100:00100000:1.0:1787864677.537075:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877632 00000100:00100000:1.0:1787864677.537133:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:1.0:1787864677.537155:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825877632:12345-192.168.206.36@tcp:40: 00000100:00100000:1.0:1787864677.537235:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825877632:12345-192.168.206.36@tcp:40: Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864677.537243:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:1.0:1787864677.542003:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864677.542049:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864677.542059:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878016 00000100:00100000:3.0:1787864677.542069:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878016 00000100:00100000:3.0:1787864677.542131:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864677.542140:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825878016:12345-192.168.206.36@tcp:900: 00000100:00100000:3.0:1787864677.542222:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825878016:12345-192.168.206.36@tcp:900: Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864677.542230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:0.0:1787864677.542928:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877760 00000100:00100000:0.0:1787864677.542934:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877760 00000100:00100000:0.0:1787864677.542971:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:0.0:1787864677.542977:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1874711825877760:12345-192.168.206.36@tcp:8: 00010000:00080000:0.0:1787864677.543002:0:8820:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787864677.543050:0:8820:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc4329d 00002000:00100000:0.0:1787864677.543061:0:8820:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 545fdf19-2645-4c06-a6f5-05dea3348b20/ffff927447eaa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864677.543077:0:8820:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 77 00002000:00080000:0.0:1787864677.543240:0:8820:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864677.543270:0:8820:0:(import.c:65:import_set_state_nolock()) ffff927447ea8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864677.543323:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825877760:12345-192.168.206.36@tcp:8: Request processed in 345us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.543337:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:1.0:1787864677.548226:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864677.548275:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864677.548324:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864677.548435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878272 00000100:00100000:3.0:1787864677.548444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878272 00000100:00100000:3.0:1787864677.548500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:3.0:1787864677.548509:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825878272:12345-192.168.206.36@tcp:33: 00000100:00100000:2.0:1787864677.548804:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878144 00000100:00100000:2.0:1787864677.548809:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878144 00000100:00100000:2.0:1787864677.548837:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 195 00000100:00100000:2.0:1787864677.548844:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825878144:12345-192.168.206.36@tcp:400: 00000100:00100000:2.0:1787864677.548925:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825878144:12345-192.168.206.36@tcp:400: Request processed in 81us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.548932:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 195 00000100:00100000:0.0:1787864677.555272:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825877888 00000100:00100000:0.0:1787864677.555286:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825877888 00000100:00100000:0.0:1787864677.555346:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:0.0:1787864677.555356:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1874711825877888:12345-192.168.206.36@tcp:8: 00010000:00080000:0.0:1787864677.555390:0:8425:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787864677.555423:0:8425:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc432a4 00002000:00100000:0.0:1787864677.555514:0:8425:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 545fdf19-2645-4c06-a6f5-05dea3348b20/ffff92757fad4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864677.555532:0:8425:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 77 00002000:00080000:0.0:1787864677.556585:0:8425:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787864677.556622:0:8425:0:(import.c:65:import_set_state_nolock()) ffff92757fad1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864677.556756:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825877888:12345-192.168.206.36@tcp:8: Request processed in 1400us (8537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.556766:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000004:00080000:1.0:1787864677.588624:0:6513:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 40037us 00000004:00200000:2.0:1787864677.614733:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787864677.614849:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6185:x1874711825878272:12345-192.168.206.36@tcp:33: Request processed in 66336us (66519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.614865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:0.0:1787864677.657304:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864677.657329:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844798080:0@lo:13: 00000100:00100000:0.0:1787864677.657389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864677.657473:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798080 00000100:00100000:0.0:1787864677.657479:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798080 00000100:00100000:0.0:1787864677.657531:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864677.657541:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844798080:12345-0@lo:13: 00002000:00000024:0.0:1787864677.657561:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864677.657604:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844798080:12345-0@lo:13: Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.657610:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787864677.657692:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa61c0 x1874711844798080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864677.657702:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1787864677.657722:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844798080:0@lo:13: 00000100:00100000:2.0:1787864677.660267:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844798464:0@lo:400: 00000100:00100000:2.0:1787864677.660335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660367:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844798976:0@lo:400: 00000100:00100000:2.0:1787864677.660390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660407:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844799488:0@lo:400: 00000100:00100000:2.0:1787864677.660439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660462:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787864677.660468:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844798336:0@lo:400: 00000100:00100000:2.0:1787864677.660490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660514:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844798848:0@lo:400: 00000100:00100000:2.0:1787864677.660534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660548:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844799360:0@lo:400: 00000100:00100000:2.0:1787864677.660569:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.660607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798464 00000100:00100000:2.0:1787864677.660613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798464 00000100:00100000:2.0:1787864677.660654:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864677.660677:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844798464:12345-0@lo:400: 00000100:00100000:2.0:1787864677.660728:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844798464:12345-0@lo:400: Request processed in 52us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.660735:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864677.660773:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844798464:0@lo:400: 00000100:00100000:2.0:1787864677.660797:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798976 00000100:00100000:2.0:1787864677.660800:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798976 00000100:00100000:2.0:1787864677.660820:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799488 00000100:00100000:2.0:1787864677.660823:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799488 00000100:00100000:2.0:1787864677.660833:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798336 00000100:00100000:2.0:1787864677.660835:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798336 00000100:00100000:2.0:1787864677.660861:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798848 00000100:00100000:2.0:1787864677.660864:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798848 00000100:00100000:2.0:1787864677.660876:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799360 00000100:00100000:2.0:1787864677.660878:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799360 00000100:00100000:2.0:1787864677.660916:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787864677.660923:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844798976:12345-0@lo:400: 00000100:00100000:2.0:1787864677.660958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844798976:12345-0@lo:400: Request processed in 35us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.660964:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787864677.660975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787864677.660981:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844799488:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661007:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844799488:12345-0@lo:400: Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.661012:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787864677.661023:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864677.661036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844798336:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661065:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844798336:12345-0@lo:400: Request processed in 30us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.661070:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864677.661083:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864677.661088:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844798848:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661113:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844798848:12345-0@lo:400: Request processed in 25us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.661119:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864677.661128:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864677.661140:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844799360:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661165:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844799360:12345-0@lo:400: Request processed in 32us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.661172:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787864677.661201:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558998b40 x1874711844798336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661212:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844798336:0@lo:400: 00010000:00080000:2.0:1787864677.661223:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93c00 x1874711844798848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661232:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844798848:0@lo:400: 00010000:00080000:2.0:1787864677.661241:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91a40 x1874711844799360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661249:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844799360:0@lo:400: 00010000:00080000:2.0:1787864677.661258:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93840 x1874711844798976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661272:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844798976:0@lo:400: 00010000:00080000:2.0:1787864677.661285:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90b40 x1874711844799488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844799488:0@lo:400: 00000100:00100000:2.0:1787864677.661354:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844798208:0@lo:400: 00000100:00100000:2.0:1787864677.661387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.661418:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844798720:0@lo:400: 00000100:00100000:2.0:1787864677.661453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.661480:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844799232:0@lo:400: 00000100:00100000:3.0:1787864677.661499:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798720 00000100:00100000:2.0:1787864677.661509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864677.661512:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798720 00000100:00100000:2.0:1787864677.661531:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799744:0@lo:13: 00000100:00100000:3.0:1787864677.661546:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787864677.661555:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844798720:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.661607:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844798720:0@lo:400: 00000100:00100000:3.0:1787864677.661611:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844798720:12345-0@lo:400: Request processed in 56us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864677.661619:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787864677.661621:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864677.661629:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844798592:0@lo:400: 00000100:00100000:2.0:1787864677.661657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864677.661674:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799104:0@lo:400: 00000100:00100000:3.0:1787864677.661676:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798592 00000100:00100000:3.0:1787864677.661682:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798592 00000100:00100000:2.0:1787864677.661699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864677.661711:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864677.661719:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799616:0@lo:400: 00000100:00100000:3.0:1787864677.661722:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844798592:12345-0@lo:400: 00000100:00100000:2.0:1787864677.661747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864677.661773:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844798592:12345-0@lo:400: Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864677.661783:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1787864677.661783:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558996580 x1874711844798592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864677.661795:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844798592:0@lo:400: 00000100:00100000:0.0:1787864677.661955:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799232 00000100:00100000:0.0:1787864677.661959:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799232 00000100:00100000:0.0:1787864677.661995:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799104 00000100:00100000:0.0:1787864677.661998:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799104 00000100:00100000:0.0:1787864677.662012:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799616 00000100:00100000:0.0:1787864677.662014:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799616 00000100:00100000:0.0:1787864677.662027:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864677.662033:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844799232:12345-0@lo:400: 00000100:00100000:0.0:1787864677.662157:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844799232:12345-0@lo:400: Request processed in 123us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.662164:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864677.662177:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864677.662183:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799104:12345-0@lo:400: 00000100:00100000:0.0:1787864677.662223:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799104:12345-0@lo:400: Request processed in 40us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.662229:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864677.662240:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864677.662245:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799616:12345-0@lo:400: 00000100:00100000:0.0:1787864677.662272:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799616:12345-0@lo:400: Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.662278:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864677.662300:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799744 00000100:00100000:0.0:1787864677.662303:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799744 00000100:00100000:0.0:1787864677.662336:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787864677.662342:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799744:12345-0@lo:13: 00002000:00000024:0.0:1787864677.662356:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864677.662387:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844799744:12345-0@lo:13: Request processed in 45us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.662393:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787864677.662491:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864677.662496:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864677.662499:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864677.662501:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787864677.662530:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c912c0 x1874711844799104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864677.662542:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799104:0@lo:400: 00010000:00080000:3.0:1787864677.662690:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91e00 x1874711844799616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864677.662701:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787864677.662714:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799616:0@lo:400: 00010000:00080000:3.0:1787864677.662728:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93480 x1874711844799232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864677.662736:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844799232:0@lo:400: 00010000:00080000:3.0:1787864677.662746:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274481861c0 x1874711844799744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864677.662772:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844799744:0@lo:13: 00000100:00100000:0.0:1787864677.665265:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844798208 00000100:00100000:0.0:1787864677.665276:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844798208 00000100:00100000:0.0:1787864677.665337:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787864677.665347:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844798208:12345-0@lo:400: 00000100:00100000:0.0:1787864677.665452:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844798208:12345-0@lo:400: Request processed in 106us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.665460:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787864677.665719:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844798208:0@lo:400: 00010000:00010000:2.0:1787864677.721232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864677.821957:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864677.822481:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878400 00000100:00100000:0.0:1787864677.822491:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878400 00000100:00100000:0.0:1787864677.822552:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:0.0:1787864677.822562:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6228:x1874711825878400:12345-192.168.206.36@tcp:101: 00010000:00010000:0.0:1787864677.822581:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864677.822604:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31c00/0x2fcb8c294dc432ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac83d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822663:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822685:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822700:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864677.822756:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787864677.822760:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864677.822777:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822804:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31c00/0x2fcb8c294dc432ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac83d expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822821:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac83d expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864677.822829:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864677.822832:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864677.822836:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31a00, rc 0) 00000100:00100000:0.0:1787864677.822939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:6228:x1874711825878400:12345-192.168.206.36@tcp:101: Request processed in 378us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864677.822946:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:2.0:1787864678.687187:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864678.687260:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844799872:0@lo:41: 00000100:00100000:2.0:1787864678.687326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864678.687606:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844799872 00000100:00100000:3.0:1787864678.687613:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844799872 00000100:00100000:3.0:1787864678.687662:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787864678.687671:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844799872:12345-0@lo:41: 00000004:00000024:3.0:1787864678.687704:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864678.687766:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844799872:12345-0@lo:41: Request processed in 96us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864678.687773:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864678.688055:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844799872:0@lo:41: 00010000:00010000:2.0:1787864678.745103:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864679.193335:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844800000:0@lo:13: 00000100:00100000:1.0:1787864679.193355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844800128:0@lo:13: 00000100:00100000:1.0:1787864679.193405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864679.194016:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800128 00000100:00100000:0.0:1787864679.194024:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800128 00000100:00100000:0.0:1787864679.194144:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787864679.194156:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844800128:12345-0@lo:13: 00002000:00000024:0.0:1787864679.194195:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864679.196926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787864679.196999:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864679.197018:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787864679.197029:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787864679.197144:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844800128:12345-0@lo:13: Request processed in 2990us (3736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864679.197156:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864679.197470:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800000 00010000:00080000:1.0:1787864679.197571:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa61c0 x1874711844800128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864679.197590:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844800128:0@lo:13: 00000100:00100000:3.0:1787864679.198399:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800000 00000100:00100000:3.0:1787864679.198462:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787864679.198471:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844800000:12345-0@lo:13: 00000100:00080000:0.0:1787864679.198570:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787864679.199167:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864679.203282:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844800000:12345-0@lo:13: Request processed in 4804us (6353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864679.203296:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787864679.205235:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448187480 x1874711844800000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864679.205261:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844800000:0@lo:13: 00010000:00010000:2.0:1787864679.769913:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864679.849121:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864679.849640:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878528 00000100:00100000:0.0:1787864679.849659:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878528 00000100:00100000:0.0:1787864679.849734:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:0.0:1787864679.849746:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:6280:x1874711825878528:12345-192.168.206.36@tcp:41: 00000100:00080000:2.0:1787864679.849906:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1787864679.850208:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787864679.850284:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:6280:x1874711825878528:12345-192.168.206.36@tcp:41: Request processed in 540us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864679.850293:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:2.0:1787864679.854804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864679.855087:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878656 00000100:00100000:0.0:1787864679.855096:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878656 00000100:00100000:0.0:1787864679.855168:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:0.0:1787864679.855180:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878656:12345-192.168.206.36@tcp:41: 00000004:00000024:0.0:1787864679.855218:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864679.855343:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878656:12345-192.168.206.36@tcp:41: Request processed in 166us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864679.855351:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00080000:2.0:1787864679.855408:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864679.867813:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864679.871411:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878784 00000100:00100000:0.0:1787864679.871436:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878784 00000100:00100000:0.0:1787864679.874528:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:0.0:1787864679.874541:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878784:12345-192.168.206.36@tcp:13: 00002000:00000024:0.0:1787864679.874565:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864679.874636:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878784:12345-192.168.206.36@tcp:13: Request processed in 98us (6832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864679.874643:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00080000:2.0:1787864679.875130:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864679.880619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864679.881047:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825878912 00000100:00100000:3.0:1787864679.881058:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825878912 00000100:00100000:3.0:1787864679.881131:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:3.0:1787864679.881142:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878912:12345-192.168.206.36@tcp:13: 00000100:00080000:2.0:1787864679.881171:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787864679.881189:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864679.881272:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:545fdf19-2645-4c06-a6f5-05dea3348b20+6:6280:x1874711825878912:12345-192.168.206.36@tcp:13: Request processed in 132us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864679.881280:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:1.0:1787864680.217682:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864680.217709:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844800256:0@lo:41: 00000100:00100000:1.0:1787864680.217796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864680.217928:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800256 00000100:00100000:2.0:1787864680.217936:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800256 00000100:00100000:2.0:1787864680.217987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864680.217996:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844800256:12345-0@lo:41: 00000004:00000024:2.0:1787864680.218026:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787864680.218074:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844800256:12345-0@lo:41: Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864680.218082:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864680.218175:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844800256:0@lo:41: 00010000:00010000:0.0:1787864680.793652:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787864681.755799:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00010000:00010000:2.0:1787864681.818634:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864682.593133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864682.593264:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864682.593342:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864682.593382:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864682.593425:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879040 00000100:00100000:0.0:1787864682.593437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879040 00000100:00100000:0.0:1787864682.593507:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 197 00000100:00100000:0.0:1787864682.593519:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825879040:12345-192.168.206.36@tcp:400: 00000100:00100000:0.0:1787864682.593615:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825879040:12345-192.168.206.36@tcp:400: Request processed in 99us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864682.593624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 197 00000100:00100000:3.0:1787864682.594610:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879552 00000100:00100000:3.0:1787864682.594621:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879552 00000100:00100000:3.0:1787864682.594769:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864682.594780:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825879552:12345-192.168.206.36@tcp:400: 00000100:00080000:0.0:1787864682.594782:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864682.594844:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825879552:12345-192.168.206.36@tcp:400: Request processed in 67us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864682.594852:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:2.0:1787864682.597246:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879296 00000100:00100000:2.0:1787864682.597286:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879296 00000100:00100000:1.0:1787864682.597337:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864682.597374:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879424 00000100:00100000:1.0:1787864682.597378:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879424 00000100:00100000:2.0:1787864682.597380:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879168 00000100:00100000:2.0:1787864682.597385:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879168 00000100:00100000:1.0:1787864682.597435:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:2.0:1787864682.597438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:1.0:1787864682.597451:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825879424:12345-192.168.206.36@tcp:400: 00000100:00100000:2.0:1787864682.597453:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825879296:12345-192.168.206.36@tcp:400: 00000100:00100000:2.0:1787864682.597544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825879296:12345-192.168.206.36@tcp:400: Request processed in 96us (4279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.597552:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:2.0:1787864682.597588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:2.0:1787864682.597596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825879168:12345-192.168.206.36@tcp:400: 00000100:00080000:3.0:1787864682.597975:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864682.597982:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864682.597985:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864682.601060:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825879424:12345-192.168.206.36@tcp:400: Request processed in 3595us (3709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.601079:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:2.0:1787864682.602238:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825879168:12345-192.168.206.36@tcp:400: Request processed in 4630us (8843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.602255:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:1.0:1787864682.778505:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844800384:0@lo:13: 00000100:00100000:1.0:1787864682.778614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864682.778689:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864682.778695:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844800512:0@lo:13: 00000100:00100000:1.0:1787864682.778719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864682.778755:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800384 00000100:00100000:1.0:1787864682.778763:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800384 00000100:00100000:1.0:1787864682.778828:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800512 00000100:00100000:1.0:1787864682.778832:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800512 00000100:00100000:1.0:1787864682.778851:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787864682.778860:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844800384:12345-0@lo:13: 00002000:00000024:1.0:1787864682.779048:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864682.779104:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844800384:12345-0@lo:13: Request processed in 244us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.779113:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787864682.779133:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864682.779147:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844800512:12345-0@lo:13: 00002000:00000024:1.0:1787864682.779157:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864682.779181:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844800512:12345-0@lo:13: Request processed in 35us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.780018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844800768:0@lo:400: 00000100:00100000:2.0:1787864682.780070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864682.780100:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844801280:0@lo:400: 00000100:00100000:2.0:1787864682.780122:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864682.780140:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844801792:0@lo:400: 00000100:00100000:2.0:1787864682.780161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864682.780183:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787864682.780188:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844800640:0@lo:400: 00000100:00100000:2.0:1787864682.780218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864682.780245:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844801152:0@lo:400: 00000100:00100000:2.0:1787864682.780269:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864682.780285:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844801664:0@lo:400: 00000100:00100000:2.0:1787864682.780316:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864682.780348:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801664 00000100:00100000:3.0:1787864682.780355:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801664 00000100:00100000:2.0:1787864682.780366:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800768 00000100:00100000:2.0:1787864682.780369:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800768 00000100:00100000:2.0:1787864682.780397:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801280 00000100:00100000:2.0:1787864682.780412:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801280 00000100:00100000:3.0:1787864682.780413:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864682.780421:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844801664:12345-0@lo:400: 00000100:00100000:2.0:1787864682.780427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801792 00000100:00100000:2.0:1787864682.780429:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801792 00000100:00100000:2.0:1787864682.780442:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787864682.780448:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844800768:12345-0@lo:400: 00000100:00100000:3.0:1787864682.780476:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844801664:12345-0@lo:400: Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864682.780485:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864682.780509:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864682.780516:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844801280:12345-0@lo:400: 00000100:00100000:1.0:1787864682.780576:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787864682.780600:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864682.780606:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864682.780608:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864682.780622:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844800896:0@lo:400: 00000100:00100000:0.0:1787864682.780702:0:8448:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787864682.780723:0:8448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787864682.781082:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787864682.781094:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844801792:12345-0@lo:400: 00000100:00100000:2.0:1787864682.781190:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844800768:12345-0@lo:400: Request processed in 741us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.781198:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787864682.781228:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800640 00000100:00100000:2.0:1787864682.781235:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800640 00000100:00100000:2.0:1787864682.781265:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787864682.781271:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844800640:12345-0@lo:400: 00000100:00100000:2.0:1787864682.781309:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844800640:12345-0@lo:400: Request processed in 38us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.781314:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787864682.781343:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801152 00000100:00100000:2.0:1787864682.781346:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801152 00000100:00100000:2.0:1787864682.781371:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787864682.781377:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844801152:12345-0@lo:400: 00000100:00100000:2.0:1787864682.781420:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844801152:12345-0@lo:400: Request processed in 43us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.781426:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787864682.781453:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844801024:0@lo:400: 00000100:00100000:2.0:1787864682.781484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864682.781494:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844801280:12345-0@lo:400: Request processed in 978us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864682.781502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787864682.781515:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844801536:0@lo:400: 00000100:00100000:3.0:1787864682.781520:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801024 00000100:00100000:3.0:1787864682.781522:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801024 00000100:00100000:2.0:1787864682.781540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864682.781545:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787864682.781550:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844801024:12345-0@lo:400: 00000100:00100000:1.0:1787864682.783422:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864682.783478:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844801408:0@lo:400: 00000100:00100000:1.0:1787864682.783512:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864682.783534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844801920:0@lo:400: 00000100:00100000:1.0:1787864682.783561:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787864682.783610:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa52c0 x1874711844800512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864682.783640:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844800512:0@lo:13: 00010000:00080000:1.0:1787864682.783657:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbbcf00 x1874711844800384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864682.783671:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844800384:0@lo:13: 00000100:00100000:1.0:1787864682.783732:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801536 00000100:00100000:1.0:1787864682.783739:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801536 00000100:00100000:1.0:1787864682.783799:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864682.783808:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558998b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844801536:12345-0@lo:400: 00000100:00100000:1.0:1787864682.783863:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558998b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844801536:12345-0@lo:400: Request processed in 56us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.783877:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864682.784028:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844800896 00000100:00100000:1.0:1787864682.784033:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844800896 00000100:00100000:1.0:1787864682.784061:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864682.784068:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844800896:12345-0@lo:400: 00000100:00100000:1.0:1787864682.784113:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844800896:12345-0@lo:400: Request processed in 45us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.784119:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864682.784138:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787864682.784146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801408 00000100:00100000:1.0:1787864682.784149:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801408 00000100:00100000:1.0:1787864682.784167:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787864682.784172:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844801920 00000100:00100000:1.0:1787864682.784174:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844801920 00000100:00100000:1.0:1787864682.784199:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787864682.784205:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864682.784211:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844801408:12345-0@lo:400: 00000100:00100000:1.0:1787864682.784237:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844801408:12345-0@lo:400: Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864682.784237:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844801792:12345-0@lo:400: Request processed in 3145us (4074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.784243:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864682.784253:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787864682.784358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844801024:12345-0@lo:400: Request processed in 2806us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864682.786096:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844800640:0@lo:400: 00000100:00100000:2.0:1787864682.786123:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844801152:0@lo:400: 00010000:00080000:2.0:1787864682.786143:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa6d00 x1874711844801664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864682.786157:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844801664:0@lo:400: 00000100:00100000:2.0:1787864682.786176:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844800768:0@lo:400: 00000100:00100000:2.0:1787864682.786193:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844801280:0@lo:400: 00000100:00100000:2.0:1787864682.786206:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844801792:0@lo:400: 00000100:00100000:0.0:1787864682.787662:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864682.787691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864682.787716:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787864682.788337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844801024:0@lo:400: 00010000:00080000:3.0:1787864682.788358:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa5680 x1874711844801536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864682.788370:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844801536:0@lo:400: 00000100:00080000:3.0:1787864682.788426:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864682.788434:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864682.788815:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844801920:12345-0@lo:400: 00000100:00100000:1.0:1787864682.789255:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844801920:12345-0@lo:400: Request processed in 378us (5619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864682.789266:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787864682.789325:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844800896:0@lo:400: 00010000:00080000:1.0:1787864682.789357:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa6940 x1874711844801408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864682.789367:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844801408:0@lo:400: 00010000:00080000:1.0:1787864682.789379:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa70c0 x1874711844801920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864682.789389:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844801920:0@lo:400: 00000001:00100000:0.0:1787864682.791611:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000001:00100000:1.0:1787864682.791724:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000001:00100000:3.0:1787864682.791784:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00010000:00010000:0.0:1787864682.842138:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864682.874841:0:10175:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787864683.801240:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844802048:0@lo:41: 00000100:00100000:3.0:1787864683.801336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864683.801464:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802048 00000100:00100000:3.0:1787864683.801473:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802048 00000100:00100000:3.0:1787864683.801532:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864683.801542:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844802048:12345-0@lo:41: 00000004:00000024:3.0:1787864683.801597:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864683.801651:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844802048:12345-0@lo:41: Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864683.801658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864683.801709:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844802048:0@lo:41: 00010000:00010000:2.0:1787864683.867020:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864684.313169:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864684.313205:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844802176:0@lo:13: 00000100:00100000:1.0:1787864684.313299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864684.313640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844802304:0@lo:13: 00000100:00100000:1.0:1787864684.313670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864684.313754:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802176 00000100:00100000:2.0:1787864684.313764:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802176 00000100:00100000:2.0:1787864684.313837:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802304 00000100:00100000:2.0:1787864684.313840:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802304 00000100:00100000:2.0:1787864684.313862:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787864684.313872:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844802176:12345-0@lo:13: 00002000:00000024:2.0:1787864684.313933:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864684.313991:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844802176:12345-0@lo:13: Request processed in 120us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864684.314000:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787864684.314020:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787864684.314028:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844802304:12345-0@lo:13: 00002000:00000024:2.0:1787864684.314038:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864684.314072:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844802304:12345-0@lo:13: Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864684.314078:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787864684.314199:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864684.314240:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d4000 x1874711844802304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864684.314260:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844802304:0@lo:13: 00010000:00080000:1.0:1787864684.314273:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558999e00 x1874711844802176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864684.314284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844802176:0@lo:13: 00010000:00010000:3.0:1787864684.890702:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864685.338294:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864685.351674:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844802432:0@lo:41: 00000100:00100000:3.0:1787864685.351783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864685.352123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802432 00000100:00100000:2.0:1787864685.352134:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802432 00000100:00100000:2.0:1787864685.352195:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787864685.352206:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844802432:12345-0@lo:41: 00000004:00000024:2.0:1787864685.352254:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787864685.352323:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844802432:12345-0@lo:41: Request processed in 118us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864685.352330:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864685.361840:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844802432:0@lo:41: 00010000:00010000:1.0:1787864685.913226:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787864686.624783:0:10322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc3b3a070 20000000:00000080:3.0:1787864686.624807:0:10322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92744823b400 uarg=0000000000000000 20000000:01000000:3.0:1787864686.624871:0:10322:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787864686.624874:0:10322:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787864686.624878:0:10322:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787864686.624884:0:10322:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787864686.625289:0:10322:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787864686.625363:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1787864686.625365:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787864686.626775:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1787864686.627807:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1787864686.627844:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1787864686.627863:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1787864686.627875:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787864686.627878:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787864686.628556:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787864686.628883:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787864686.629167:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787864686.629184:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787864686.629200:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787864686.629202:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787864686.629484:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787864686.629795:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787864686.629818:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787864686.629834:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1787864686.629845:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787864686.629846:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787864686.630236:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787864686.630403:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787864686.630425:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787864686.630442:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787864686.630451:0:10322:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787864686.630453:0:10322:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787864686.631530:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1787864686.631777:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1787864686.631805:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1787864686.631819:0:10322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:3.0:1787864686.631835:0:10322:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787864686.631862:0:10322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.631885:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632363:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632372:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632392:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632400:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632408:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632416:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632424:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632431:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632441:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632449:0:10322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632467:0:10322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632517:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632535:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 9 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864686.632552:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802560:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864686.632732:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632741:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 9 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864686.632751:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802688:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864686.632786:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.632795:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 23 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864686.632806:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802816:0@lo:104: 00000100:00100000:3.0:1787864686.632854:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864686.633299:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.633320:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 23 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864686.633330:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802944:0@lo:104: 00000100:00100000:3.0:1787864686.633357:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864686.633884:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802816 00000100:00100000:1.0:1787864686.633924:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802816 00000100:00100000:1.0:1787864686.633971:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844802944 00000100:00100000:1.0:1787864686.633975:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844802944 00000100:00100000:1.0:1787864686.634004:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864686.634015:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844802816:12345-0@lo:104: 00010000:00010000:1.0:1787864686.634159:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.634226:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864686.634233:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844802816:12345-0@lo:104: Request processed in 220us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.634241:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864686.634261:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864686.634268:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844802944:12345-0@lo:104: 00010000:00010000:1.0:1787864686.634277:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.634354:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864686.634360:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844802944:12345-0@lo:104: Request processed in 93us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.634367:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787864686.634581:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.634594:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 23 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.634613:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803072:0@lo:104: 00000100:00100000:2.0:1787864686.634646:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864686.634676:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.634685:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 23 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.634694:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803200:0@lo:104: 00000100:00100000:2.0:1787864686.634718:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.634748:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864686.634758:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803072 00000100:00100000:2.0:1787864686.634762:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803072 00000100:00100000:2.0:1787864686.634779:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803200 00000100:00100000:2.0:1787864686.634781:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803200 00000100:00100000:2.0:1787864686.634790:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864686.634795:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844803072:12345-0@lo:104: 00010000:00010000:2.0:1787864686.634803:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.634932:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864686.634941:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.634949:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864686.634954:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.634963:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864686.634982:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864686.634988:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864686.635021:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635239:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864686.635272:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635280:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446797200/0x2fcb8c294dc4325e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43265 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635312:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864686.635316:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635322:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864686.635325:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635332:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864686.635338:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864686.635343:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864686.635368:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635374:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864686.635401:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635409:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824f400/0x2fcb8c294dc43234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4323b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635419:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864686.635422:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635428:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796e00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864686.635431:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635437:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864686.635443:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864686.635448:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864686.635463:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635469:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864686.635474:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635492:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4321f expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635502:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864686.635504:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864686.635506:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864686.635517:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864686.635534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844803328:0@lo:103: 00000100:00100000:0.0:1787864686.635599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864686.635639:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844803456:0@lo:103: 00000100:00100000:0.0:1787864686.635662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864686.635681:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864686.635687:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844803584:0@lo:103: 00000100:00100000:0.0:1787864686.635706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864686.635736:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803328 00000100:00100000:0.0:1787864686.635740:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803328 00010000:00010000:0.0:1787864686.635768:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 24 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.635787:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803456 00000100:00100000:0.0:1787864686.635790:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803456 00010000:00010000:0.0:1787864686.635800:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 25 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.635809:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803584 00000100:00100000:0.0:1787864686.635812:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803584 00010000:00010000:0.0:1787864686.635821:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 26 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.635846:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787864686.635854:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3637:x1874711844803328:12345-0@lo:103: 00010000:00010000:0.0:1787864686.635867:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864686.635872:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 26 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635881:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 26 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.635936:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864686.635966:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3637:x1874711844803328:12345-0@lo:103: Request processed in 113us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.635974:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787864686.636158:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864686.636168:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3639:x1874711844803456:12345-0@lo:103: 00010000:00010000:0.0:1787864686.636176:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864686.636180:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 25 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.636188:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 25 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.636198:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864686.636403:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864686.636445:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3639:x1874711844803456:12345-0@lo:103: Request processed in 278us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.636451:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864686.636464:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864686.636477:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844803584:12345-0@lo:103: 00010000:00010000:0.0:1787864686.636484:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864686.636488:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 24 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.636496:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 24 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.636505:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864686.636524:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844803584:12345-0@lo:103: Request processed in 48us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.636529:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864686.636569:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844803328:0@lo:103: 00010000:00010000:2.0:1787864686.636723:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787864686.636732:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844803072:12345-0@lo:104: Request processed in 1935us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.636739:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787864686.636756:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864686.636763:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844803200:12345-0@lo:104: 00010000:00010000:2.0:1787864686.636774:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.636847:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864686.636852:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcb0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844803200:12345-0@lo:104: Request processed in 91us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.636858:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787864686.636934:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.636947:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 23 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.636959:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803712:0@lo:104: 00000100:00100000:2.0:1787864686.636986:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864686.637010:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637018:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 23 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.637036:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803840:0@lo:104: 00000100:00100000:2.0:1787864686.637055:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.637072:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803712 00000100:00100000:2.0:1787864686.637076:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803712 00000100:00100000:2.0:1787864686.637111:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803840 00000100:00100000:2.0:1787864686.637114:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803840 00000100:00100000:2.0:1787864686.637123:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864686.637128:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844803712:12345-0@lo:104: 00010000:00010000:2.0:1787864686.637135:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.637322:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844803456:0@lo:103: 00000100:00100000:1.0:1787864686.637336:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844803584:0@lo:103: 00010000:00010000:3.0:1787864686.637394:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864686.637400:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637408:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864686.637412:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637421:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864686.637428:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864686.637434:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864686.637493:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637500:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864686.637516:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637523:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc431ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431f5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637541:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864686.637544:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637550:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864686.637554:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.637560:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864686.637566:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864686.637571:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864686.637618:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787864686.637624:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844803712:12345-0@lo:104: Request processed in 495us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.637631:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864686.637644:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864686.637651:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844803840:12345-0@lo:104: 00010000:00010000:2.0:1787864686.637658:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637685:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864686.637689:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844803840:12345-0@lo:104: Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.637695:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787864686.637722:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637730:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 23 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.637740:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804096:0@lo:104: 00000100:00100000:2.0:1787864686.637759:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864686.637786:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637794:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 23 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.637802:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804224:0@lo:104: 00000100:00100000:2.0:1787864686.637824:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.637840:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804096 00000100:00100000:2.0:1787864686.637843:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804096 00000100:00100000:2.0:1787864686.637857:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804224 00000100:00100000:2.0:1787864686.637859:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804224 00000100:00100000:2.0:1787864686.637868:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864686.637872:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844804096:12345-0@lo:104: 00010000:00010000:2.0:1787864686.637879:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637938:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864686.637944:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10322:x1874711844804096:12345-0@lo:104: Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.637950:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864686.637959:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864686.637964:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844804224:12345-0@lo:104: 00010000:00010000:2.0:1787864686.637971:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.637991:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787864686.637995:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844804224:12345-0@lo:104: Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.638000:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1787864686.638019:0:10322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.638039:0:10322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 23 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.638057:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804352:0@lo:104: 00000100:00100000:2.0:1787864686.638075:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.638090:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804352 00000100:00100000:2.0:1787864686.638093:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804352 00000100:00100000:2.0:1787864686.638106:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787864686.638111:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844804352:12345-0@lo:104: 00010000:00010000:2.0:1787864686.638117:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.638138:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787864686.638143:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10322:x1874711844804352:12345-0@lo:104: Request processed in 32us (67us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.638148:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787864686.638162:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9900 going to sleep for 11 seconds 00010000:00010000:2.0:1787864686.638185:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4325e expref: 23 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.638196:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802816:0@lo:104: 00010000:00010000:2.0:1787864686.638206:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824f800/0x2fcb8c294dc4323b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43234 expref: 22 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.638214:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802944:0@lo:104: 00010000:00010000:2.0:1787864686.638223:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031400/0x2fcb8c294dc4321f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43218 expref: 21 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.638231:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803072:0@lo:104: 00000100:00100000:2.0:1787864686.638239:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803200:0@lo:104: 00000100:00100000:2.0:1787864686.638251:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803712:0@lo:104: 00000100:00100000:2.0:1787864686.638257:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844803840:0@lo:104: 00000100:00100000:2.0:1787864686.638263:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804096:0@lo:104: 00000100:00100000:2.0:1787864686.638268:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804224:0@lo:104: 00000100:00100000:2.0:1787864686.638273:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844804352:0@lo:104: 00010000:00010000:3.0:1787864686.638598:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.638606:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864686.638613:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.638621:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc431d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431d9 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.638630:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787864686.638633:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.638648:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864686.638651:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.642741:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864686.643016:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864686.643045:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.643058:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864686.643063:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.643074:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864686.643081:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864686.643087:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864686.643436:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864686.643443:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864686.643448:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864686.643499:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643506:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864686.643531:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643539:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173400/0x2fcb8c294dc431c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431cb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643554:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864686.643558:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643564:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864686.643567:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643585:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864686.643592:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864686.643598:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787864686.643613:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643620:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864686.643626:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643632:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796800/0x2fcb8c294dc4314d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43154 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864686.643644:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864686.643646:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864686.643648:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864686.643831:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864686.643861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864686.643906:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879680 00000100:00100000:1.0:1787864686.643915:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879680 00010000:00010000:1.0:1787864686.643948:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 10 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.643979:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879808 00000100:00100000:1.0:1787864686.643989:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879808 00010000:00010000:1.0:1787864686.644002:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.644020:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:1.0:1787864686.644231:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2409:x1874711825879680:12345-192.168.206.36@tcp:103: 00010000:00010000:1.0:1787864686.644248:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864686.644254:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.644268:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 11 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.644290:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864686.644351:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2409:x1874711825879680:12345-192.168.206.36@tcp:103: Request processed in 126us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.644359:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:1.0:1787864686.644396:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:1.0:1787864686.644404:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2409:x1874711825879808:12345-192.168.206.36@tcp:103: 00010000:00010000:1.0:1787864686.644412:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864686.644416:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 10 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.644426:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 10 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.644437:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864686.644455:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2409:x1874711825879808:12345-192.168.206.36@tcp:103: Request processed in 52us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.644470:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:2.0:1787864686.644608:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804480:0@lo:103: 00000100:00100000:2.0:1787864686.644661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.644720:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864686.644727:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844803968:0@lo:103: 00000100:00100000:2.0:1787864686.644749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864686.644815:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc4327a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7d4 expref: 9 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.644828:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802560:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864686.644842:0:10322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031800/0x2fcb8c294dc43273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac7cd expref: 8 pid: 6505 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.644852:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10322:1874711844802688:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864686.644920:0:10322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.644992:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804480 00000100:00100000:1.0:1787864686.644997:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804480 00010000:00010000:1.0:1787864686.645015:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 21 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.645232:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844803968 00000100:00100000:1.0:1787864686.645236:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844803968 00010000:00010000:1.0:1787864686.645249:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 22 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864686.645262:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864686.645267:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844804480:12345-0@lo:103: 00010000:00010000:1.0:1787864686.645277:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864686.645281:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 22 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645290:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 22 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645302:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582172c00/0x2fcb8c294dc431d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc431d2 expref: 22 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645313:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864686.645350:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3638:x1874711844804480:12345-0@lo:103: Request processed in 82us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.645356:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864686.645369:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864686.645375:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3638:x1874711844803968:12345-0@lo:103: 00010000:00010000:1.0:1787864686.645402:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864686.645407:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 20 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645416:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 20 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645426:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796400/0x2fcb8c294dc431f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc431ee expref: 20 pid: 6503 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.645436:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864686.645458:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3638:x1874711844803968:12345-0@lo:103: Request processed in 83us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.645464:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864686.645490:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844803968:0@lo:103: 00000100:00100000:1.0:1787864686.645498:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804480:0@lo:103: 00010000:00010000:1.0:1787864686.645906:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864686.645909:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864686.645911:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864686.645952:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.645963:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864686.645967:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.645984:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864686.645991:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864686.645996:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864686.646134:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646141:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864686.646164:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646172:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc43177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4317e expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646184:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864686.646186:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864686.646187:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864686.646575:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864686.646592:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804864:0@lo:103: 00000100:00100000:1.0:1787864686.646660:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864686.646749:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804864 00000100:00100000:2.0:1787864686.646755:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804864 00010000:00010000:2.0:1787864686.646780:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 19 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864686.646810:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864686.646819:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3638:x1874711844804864:12345-0@lo:103: 00010000:00010000:2.0:1787864686.646830:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864686.646834:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 19 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646853:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 19 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646869:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030400/0x2fcb8c294dc4317e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43177 expref: 19 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.646881:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864686.646945:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3638:x1874711844804864:12345-0@lo:103: Request processed in 127us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.646953:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864686.647140:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804864:0@lo:103: 00010000:00010000:0.0:1787864686.647224:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647233:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864686.647254:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647261:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173200/0x2fcb8c294dc431b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc431bd expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647277:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864686.647279:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864686.647282:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864686.647321:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804992:0@lo:103: 00000100:00100000:1.0:1787864686.647348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864686.647541:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804992 00000100:00100000:0.0:1787864686.647546:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804992 00010000:00010000:0.0:1787864686.647566:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 18 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.647589:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864686.647597:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3638:x1874711844804992:12345-0@lo:103: 00010000:00010000:0.0:1787864686.647605:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864686.647610:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 18 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647619:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 18 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647631:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797800/0x2fcb8c294dc431bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc431b6 expref: 18 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.647640:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864686.647679:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3638:x1874711844804992:12345-0@lo:103: Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.647686:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864686.647711:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844804992:0@lo:103: 00000100:00100000:3.0:1787864686.647857:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844804736:0@lo:103: 00000100:00100000:3.0:1787864686.647924:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864686.647950:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864686.647956:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844804608:0@lo:103: 00000100:00100000:3.0:1787864686.647979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864686.648218:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804736 00000100:00100000:1.0:1787864686.648223:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804736 00010000:00010000:1.0:1787864686.648246:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 17 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.648355:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844804608 00000100:00100000:0.0:1787864686.648359:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844804608 00010000:00010000:0.0:1787864686.648372:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 18 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864686.648406:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864686.648413:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:3640:x1874711844804608:12345-0@lo:103: 00010000:00010000:0.0:1787864686.648421:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864686.648426:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 18 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.648435:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 18 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.648447:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030200/0x2fcb8c294dc431cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc431c4 expref: 18 pid: 6504 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864686.648456:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864686.648488:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:3640:x1874711844804608:12345-0@lo:103: Request processed in 76us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.648493:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787864686.648868:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787864686.648876:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:3640:x1874711844804736:12345-0@lo:103: 00010000:00010000:1.0:1787864686.648885:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864686.648915:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648924:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648934:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031200/0x2fcb8c294dc43154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4314d expref: 16 pid: 6505 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648949:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648958:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648977:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648984:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648991:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.648998:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.649016:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864686.649020:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864686.649237:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844804608:0@lo:103: 00010000:00010000:1.0:1787864686.649341:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.649489:0:10322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.649499:0:10322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.657782:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.657811:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824e800/0x2fcb8c294dc432b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864686.657837:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864686.657984:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3640:x1874711844804736:12345-0@lo:103: Request processed in 9096us (10047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864686.657997:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864686.659644:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844804736:0@lo:103: 00000100:00100000:0.0:1787864686.935053:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864686.935152:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825879936 00000100:00100000:2.0:1787864686.935164:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825879936 00000100:00100000:2.0:1787864686.935227:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 199 00000100:00100000:2.0:1787864686.935236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:6199:x1874711825879936:12345-192.168.206.36@tcp:101: 00010000:00010000:2.0:1787864686.935255:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864686.935277:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797600/0x2fcb8c294dc432c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac844 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.935309:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797600/0x2fcb8c294dc432c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac844 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.935322:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797600/0x2fcb8c294dc432c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac844 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.935352:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797600, rc 0) 00000100:00100000:2.0:1787864686.935451:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825879936:12345-192.168.206.36@tcp:101: Request processed in 215us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.935459:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 199 00010000:00010000:3.0:1787864686.937100:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864686.937565:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864686.938092:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880064 00000100:00100000:0.0:1787864686.938105:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880064 00000100:00100000:0.0:1787864686.938179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:0.0:1787864686.938190:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825880064:12345-192.168.206.36@tcp:501: 00000100:00100000:0.0:1787864686.938749:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825880064:12345-192.168.206.36@tcp:501: Request processed in 558us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.938759:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:1.0:1787864686.943373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864686.944229:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880192 00000100:00100000:0.0:1787864686.944242:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880192 00000100:00100000:0.0:1787864686.944470:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 201 00000100:00100000:0.0:1787864686.944482:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825880192:12345-192.168.206.36@tcp:503: 00000100:00100000:0.0:1787864686.944673:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825880192:12345-192.168.206.36@tcp:503: Request processed in 192us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864686.944682:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 201 00000100:00100000:3.0:1787864686.958293:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864686.961635:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880320 00000100:00100000:2.0:1787864686.961669:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880320 00000100:00100000:2.0:1787864686.961751:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:2.0:1787864686.961763:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6674:x1874711825880320:12345-192.168.206.36@tcp:502: 00000100:00100000:2.0:1787864686.962422:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6674:x1874711825880320:12345-192.168.206.36@tcp:502: Request processed in 660us (4140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.962433:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:1.0:1787864686.965195:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864686.965791:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880448 00000100:00100000:3.0:1787864686.965836:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880448 00000100:00100000:3.0:1787864686.966801:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 203 00000100:00100000:3.0:1787864686.966821:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6674:x1874711825880448:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864686.967168:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6674:x1874711825880448:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 353us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864686.967178:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 203 00000100:00100000:1.0:1787864686.973917:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864686.975065:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880576 00000100:00100000:2.0:1787864686.975081:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880576 00000100:00100000:2.0:1787864686.975183:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 204 00000100:00100000:2.0:1787864686.975197:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825880576:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864686.975218:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864686.975243:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797400/0x2fcb8c294dc432c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac84b expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.975282:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797400/0x2fcb8c294dc432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac84b expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.975296:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797400/0x2fcb8c294dc432c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac84b expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864686.975308:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797400, rc 0) 00000100:00100000:2.0:1787864686.975421:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825880576:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 228us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864686.975430:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 204 00000100:00100000:1.0:1787864686.980239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864686.980422:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880704 00000100:00100000:3.0:1787864686.980433:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880704 00000100:00100000:3.0:1787864686.980503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 205 00000100:00100000:3.0:1787864686.980513:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825880704:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864686.980879:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825880704:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 366us (654us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864686.980931:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 205 00000100:00100000:2.0:1787864687.718535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864687.718640:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864687.718671:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864687.718730:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880832 00000100:00100000:1.0:1787864687.718740:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880832 00000100:00100000:1.0:1787864687.718801:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 206 00000100:00100000:1.0:1787864687.718810:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825880832:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864687.718932:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825880832:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864687.718941:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 206 00000100:00100000:1.0:1787864687.725435:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864687.725485:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864687.725521:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881344 00000100:00100000:1.0:1787864687.725531:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881344 00000100:00100000:1.0:1787864687.725607:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881216 00000100:00100000:1.0:1787864687.725610:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881216 00000100:00100000:1.0:1787864687.725641:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:1.0:1787864687.725651:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825881344:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864687.725736:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825881344:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 86us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864687.725744:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:1.0:1787864687.725762:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:1.0:1787864687.725769:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825881216:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864687.725794:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825881216:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864687.725800:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00080000:1.0:1787864687.725817:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864687.725821:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864687.728214:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825880960 00000100:00100000:3.0:1787864687.728233:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825880960 00000100:00100000:3.0:1787864687.728399:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881088 00000100:00100000:3.0:1787864687.728403:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881088 00000100:00100000:3.0:1787864687.728436:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:3.0:1787864687.728450:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825880960:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864687.728555:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825880960:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 110us (10036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864687.728564:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:3.0:1787864687.728582:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:3.0:1787864687.728589:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825881088:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864687.728632:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825881088:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 44us (9960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864687.728638:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00080000:1.0:1787864687.729866:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864687.729877:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864687.897333:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844805248:0@lo:13: 00000100:00100000:0.0:1787864687.897978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864687.898291:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864687.898303:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844805120:0@lo:13: 00000100:00100000:0.0:1787864687.898341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864687.898738:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805248 00000100:00100000:1.0:1787864687.898748:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805248 00000100:00100000:1.0:1787864687.898914:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805120 00000100:00100000:1.0:1787864687.898918:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805120 00000100:00100000:1.0:1787864687.898940:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864687.898951:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844805248:12345-0@lo:13: 00002000:00000024:1.0:1787864687.898990:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864687.899202:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864687.899212:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844805120:12345-0@lo:13: 00002000:00000024:2.0:1787864687.899225:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864687.899387:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844805248:12345-0@lo:13: Request processed in 437us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864687.899413:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864687.899517:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844805120:12345-0@lo:13: Request processed in 307us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864687.899523:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787864687.899725:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbbed00 x1874711844805120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864687.899749:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844805120:0@lo:13: 00010000:00080000:2.0:1787864687.899765:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa7840 x1874711844805248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864687.900958:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844805248:0@lo:13: 00000100:00100000:2.0:1787864687.901004:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844805760:0@lo:400: 00000100:00100000:3.0:1787864687.901190:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844805376:0@lo:400: 00000100:00100000:3.0:1787864687.901277:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.901324:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844805888:0@lo:400: 00000100:00100000:3.0:1787864687.901354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.901390:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787864687.901397:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844805504:0@lo:400: 00000100:00080000:0.0:1787864687.901627:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864687.901657:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844805632:0@lo:400: 00000100:00100000:0.0:1787864687.901692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864687.901729:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805888 00000100:00100000:0.0:1787864687.901736:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805888 00000100:00100000:0.0:1787864687.901854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805632 00000100:00100000:0.0:1787864687.901859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805632 00000100:00100000:0.0:1787864687.901880:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787864687.901910:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844805888:12345-0@lo:400: 00000100:00100000:0.0:1787864687.901965:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844805888:12345-0@lo:400: Request processed in 77us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.901986:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787864687.902003:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787864687.902368:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805376 00000100:00100000:2.0:1787864687.902383:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805376 00000100:00100000:2.0:1787864687.902421:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787864687.903220:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844805632:12345-0@lo:400: 00000100:00100000:1.0:1787864687.903304:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844806528:0@lo:400: 00000100:00100000:2.0:1787864687.903617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3637:x1874711844805376:12345-0@lo:400: 00000100:00100000:2.0:1787864687.903667:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:3637:x1874711844805376:12345-0@lo:400: Request processed in 245us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.903730:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844805632:12345-0@lo:400: Request processed in 1720us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.903738:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787864687.904153:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844806144:0@lo:400: 00000100:00100000:2.0:1787864687.904234:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1787864687.904680:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.904751:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844806016:0@lo:400: 00000100:00100000:1.0:1787864687.904882:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864687.904923:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844806656:0@lo:400: 00000100:00100000:1.0:1787864687.904951:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864687.904993:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844805632:0@lo:400: 00000100:00100000:2.0:1787864687.905121:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864687.905155:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864687.905164:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844806400:0@lo:400: 00000100:00100000:2.0:1787864687.905194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864687.905230:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805504 00000100:00100000:2.0:1787864687.905236:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805504 00000100:00100000:2.0:1787864687.905291:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806144 00000100:00100000:2.0:1787864687.905295:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806144 00000100:00100000:2.0:1787864687.905317:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806656 00000100:00100000:2.0:1787864687.905320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806656 00000100:00100000:2.0:1787864687.905332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806528 00000100:00100000:2.0:1787864687.905334:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806528 00000100:00100000:2.0:1787864687.905350:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787864687.905358:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844805504:12345-0@lo:400: 00000100:00100000:2.0:1787864687.905413:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844805504:12345-0@lo:400: Request processed in 56us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864687.905420:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787864687.905535:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787864687.905546:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844806144:12345-0@lo:400: 00000100:00100000:0.0:1787864687.905881:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844806144:12345-0@lo:400: Request processed in 338us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.905915:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787864687.905934:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787864687.905941:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844806656:12345-0@lo:400: 00000100:00100000:0.0:1787864687.905970:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844806656:12345-0@lo:400: Request processed in 30us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.905976:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787864687.905986:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787864687.905994:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844806528:12345-0@lo:400: 00010000:00080000:1.0:1787864687.906259:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc17c00 x1874711844806144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864687.906274:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844806144:0@lo:400: 00010000:00080000:1.0:1787864687.906286:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc16940 x1874711844806656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864687.906294:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844806656:0@lo:400: 00000100:00100000:1.0:1787864687.906309:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864687.906317:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844806272:0@lo:400: 00000100:00100000:2.0:1787864687.906404:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806400 00000100:00100000:2.0:1787864687.906410:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806400 00000100:00100000:2.0:1787864687.906457:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864687.906464:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844806400:12345-0@lo:400: 00000100:00100000:3.0:1787864687.909616:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.909718:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844805376:0@lo:400: 00000100:00100000:3.0:1787864687.909740:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844805888:0@lo:400: 00000100:00100000:3.0:1787864687.909944:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844805504:0@lo:400: 00000100:00100000:3.0:1787864687.909990:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806016 00000100:00100000:3.0:1787864687.909997:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806016 00000100:00100000:3.0:1787864687.910059:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787864687.910070:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844806016:12345-0@lo:400: 00000100:00100000:3.0:1787864687.910141:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844806016:12345-0@lo:400: Request processed in 73us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864687.910149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787864687.910182:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844806016:0@lo:400: 00000100:00100000:3.0:1787864687.910228:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.910292:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844805760 00000100:00100000:3.0:1787864687.910297:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844805760 00000100:00100000:3.0:1787864687.910319:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864687.910326:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844805760:12345-0@lo:400: 00000100:00100000:3.0:1787864687.910363:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844805760:12345-0@lo:400: Request processed in 38us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864687.910370:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864687.910407:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844805760:0@lo:400: 00000100:00080000:3.0:1787864687.910463:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864687.910468:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864687.910471:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864687.915524:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864687.917635:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806272 00000100:00100000:3.0:1787864687.917655:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806272 00000100:00100000:3.0:1787864687.917780:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864687.917793:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844806272:12345-0@lo:400: 00000100:00100000:3.0:1787864687.917940:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844806272:12345-0@lo:400: Request processed in 150us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864687.917948:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787864687.918536:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864687.918596:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc17480 x1874711844806272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864687.918613:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844806272:0@lo:400: 00000100:00100000:2.0:1787864687.919729:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844806400:12345-0@lo:400: Request processed in 13257us (14524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864687.919744:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787864687.919916:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc14b40 x1874711844806400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864687.919931:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844806400:0@lo:400: 00000100:00100000:0.0:1787864687.920075:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844806528:12345-0@lo:400: Request processed in 14080us (14951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864687.920086:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864687.920163:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844806528:0@lo:400: 00010000:00010000:1.0:1787864687.961818:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787864688.091758:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787864688.091768:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92757de48800 from 48 10000000:01000000:1.0:1787864688.091783:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787864688.091844:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.091858:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.091871:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864688.091919:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844806784:0@lo:101: 00000100:00100000:1.0:1787864688.092334:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.092399:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864688.092427:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806784 00000100:00100000:1.0:1787864688.092435:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806784 00000100:00100000:1.0:1787864688.092569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787864688.092595:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+15:6508:x1874711844806784:12345-0@lo:101: 00010000:00010000:1.0:1787864688.092613:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864688.092631:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948800/0x2fcb8c294dc432d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc432ce expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.092659:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948800/0x2fcb8c294dc432d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc432ce expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.092671:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948800/0x2fcb8c294dc432d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc432ce expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.092694:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948800, rc 0) 00000100:00100000:1.0:1787864688.093800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844806784:12345-0@lo:101: Request processed in 1214us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864688.093812:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787864688.103768:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844806784:0@lo:101: 00010000:00010000:3.0:1787864688.103812:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.103827:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864688.105881:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844806912:0@lo:501: 00000100:00100000:1.0:1787864688.106202:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.106267:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.106793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844806912 00000100:00100000:0.0:1787864688.106802:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844806912 00000100:00100000:0.0:1787864688.106862:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1787864688.106916:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844806912:12345-0@lo:501: 00000100:00100000:0.0:1787864688.107097:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844806912:12345-0@lo:501: Request processed in 185us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.107107:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787864688.107161:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844806912:0@lo:501: 00000100:00100000:2.0:1787864688.107229:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807040:0@lo:503: 00000100:00100000:2.0:1787864688.107291:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.107328:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45780 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.107385:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807040 00000100:00100000:0.0:1787864688.107390:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807040 00000100:00100000:0.0:1787864688.107424:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1787864688.107432:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844807040:12345-0@lo:503: 00000100:00100000:0.0:1787864688.107518:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844807040:12345-0@lo:503: Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.107525:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787864688.107530:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807040:0@lo:503: 00000100:00100000:0.0:1787864688.109344:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10343:1874711844807168:0@lo:502: 00000100:00100000:0.0:1787864688.109463:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.109503:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.109942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807168 00000100:00100000:2.0:1787864688.109952:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807168 00000100:00100000:2.0:1787864688.116213:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1787864688.116248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:10343:x1874711844807168:12345-0@lo:502: 00000100:00100000:2.0:1787864688.116523:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:10343:x1874711844807168:12345-0@lo:502: Request processed in 292us (7059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.116533:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1787864688.116687:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10343:1874711844807168:0@lo:502: 00000100:00100000:3.0:1787864688.116771:0:10343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10343:1874711844807296:0@lo:502: 00000100:00100000:3.0:1787864688.116831:0:10343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.124849:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807296 00000100:00100000:2.0:1787864688.124868:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807296 00000100:00100000:2.0:1787864688.125253:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1787864688.125266:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:10343:x1874711844807296:12345-0@lo:502: 00000100:00100000:2.0:1787864688.125561:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:10343:x1874711844807296:12345-0@lo:502: Request processed in 297us (8729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.125569:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1787864688.125870:0:10343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.126208:0:10343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10343:1874711844807296:0@lo:502: 00000040:00080000:3.0:1787864688.126251:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787864688.126493:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787864688.126520:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864688.126532:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.126665:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.126678:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787864688.126681:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787864688.126693:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787864688.126735:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.126744:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.126753:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.126775:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807424:0@lo:101: 00000100:00100000:2.0:1787864688.126832:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.126870:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.126916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807424 00000100:00100000:0.0:1787864688.126923:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807424 00000100:00100000:0.0:1787864688.126969:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787864688.126979:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+16:6508:x1874711844807424:12345-0@lo:101: 00010000:00010000:0.0:1787864688.126991:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864688.127006:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31c00/0x2fcb8c294dc432e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc432dc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.127031:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31c00/0x2fcb8c294dc432e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc432dc expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.127044:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31c00/0x2fcb8c294dc432e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc432dc expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.127065:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31c00, rc 0) 00000100:00100000:0.0:1787864688.127115:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844807424:12345-0@lo:101: Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.127122:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787864688.127242:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807424:0@lo:101: 00010000:00010000:2.0:1787864688.127258:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.127269:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.127327:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807552:0@lo:501: 00000100:00100000:2.0:1787864688.127352:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.127390:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.128117:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807552 00000100:00100000:0.0:1787864688.128126:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807552 00000100:00100000:0.0:1787864688.128165:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1787864688.128173:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844807552:12345-0@lo:501: 00000100:00100000:0.0:1787864688.130217:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844807552:12345-0@lo:501: Request processed in 2026us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.130233:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787864688.136061:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807552:0@lo:501: 00000100:00100000:1.0:1787864688.138167:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807680:0@lo:503: 00000100:00100000:1.0:1787864688.138386:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.138484:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.138531:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807680 00000100:00100000:2.0:1787864688.138540:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807680 00000100:00100000:2.0:1787864688.142871:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787864688.142911:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844807680:12345-0@lo:503: 00000100:00100000:2.0:1787864688.143127:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844807680:12345-0@lo:503: Request processed in 241us (4753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.143145:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787864688.143981:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844807680:0@lo:503: 00000100:00100000:0.0:1787864688.147125:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10346:1874711844807808:0@lo:502: 00000100:00100000:0.0:1787864688.147240:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.147291:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.147671:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807808 00000100:00100000:3.0:1787864688.147679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807808 00000100:00100000:3.0:1787864688.147738:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787864688.147749:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:10346:x1874711844807808:12345-0@lo:502: 00000100:00100000:3.0:1787864688.148133:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:10346:x1874711844807808:12345-0@lo:502: Request processed in 385us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.148142:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787864688.148250:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10346:1874711844807808:0@lo:502: 00000020:01000000:1.0:1787864688.148287:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864688.148299:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864688.148301:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787864688.148306:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787864688.148336:0:10346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10346:1874711844807936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864688.148385:0:10346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.148413:0:10346:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.148609:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844807936 00000100:00100000:0.0:1787864688.148614:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844807936 00000100:00100000:0.0:1787864688.148651:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1787864688.148659:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:10346:x1874711844807936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.148741:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:10346:x1874711844807936:12345-0@lo:502:llog_process_th.0 Request processed in 82us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.148749:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787864688.149083:0:10346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10346:1874711844807936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864688.149105:0:10346:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864688.149111:0:10346:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864688.149112:0:10346:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787864688.149117:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1787864688.149396:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787864688.149420:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787864688.149432:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.149445:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864688.149457:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787864688.149459:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92757bdea800 from 48 10000000:01000000:3.0:1787864688.149462:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864688.149493:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.149503:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.149527:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.149546:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864688.149599:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864688.149628:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.150023:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808064 00000100:00100000:0.0:1787864688.150030:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808064 00000100:00100000:0.0:1787864688.150073:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787864688.150082:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+17:6508:x1874711844808064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.150102:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864688.150116:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30e00/0x2fcb8c294dc432f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc432ea expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.150142:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30e00/0x2fcb8c294dc432f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc432ea expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.150154:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30e00/0x2fcb8c294dc432f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc432ea expref: 18 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.150163:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30e00, rc 0) 00000100:00100000:0.0:1787864688.150334:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.150342:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787864688.151361:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864688.151399:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.151420:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864688.151509:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864688.151612:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.151651:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.151807:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808192 00000100:00100000:0.0:1787864688.151814:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808192 00000100:00100000:0.0:1787864688.151863:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787864688.151873:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.152068:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 196us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.152076:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787864688.152112:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.152148:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.152190:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.152322:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808320 00000100:00100000:0.0:1787864688.152327:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808320 00000100:00100000:0.0:1787864688.152353:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787864688.152367:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.152462:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.152469:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787864688.152501:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.152514:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864688.154202:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10348:1874711844808448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.154288:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864688.154341:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.154517:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808448 00000100:00100000:2.0:1787864688.154525:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808448 00000100:00100000:2.0:1787864688.154580:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787864688.154591:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:10348:x1874711844808448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.155654:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:10348:x1874711844808448:12345-0@lo:502:llog_process_th.0 Request processed in 1059us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.155666:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787864688.155948:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10348:1874711844808448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.156021:0:10348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10348:1874711844808576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.156072:0:10348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.160631:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808576 00000100:00100000:0.0:1787864688.160649:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808576 00000100:00100000:3.0:1787864688.160720:0:10348:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.160730:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787864688.160742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:10348:x1874711844808576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.160958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:10348:x1874711844808576:12345-0@lo:502:llog_process_th.0 Request processed in 217us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.160967:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787864688.162281:0:10348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10348:1874711844808576:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787864688.162336:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787864688.162573:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1787864688.162671:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787864688.162684:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.162698:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864688.162774:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787864688.162778:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787864688.162781:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864688.162825:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.162833:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.162851:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864688.162875:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.163077:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.163116:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.164164:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808704 00000100:00100000:3.0:1787864688.164176:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808704 00000100:00100000:3.0:1787864688.164242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787864688.164253:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+18:6508:x1874711844808704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864688.164271:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864688.164291:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824f600/0x2fcb8c294dc432ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc432f8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.164320:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824f600/0x2fcb8c294dc432ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc432f8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.164344:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824f600/0x2fcb8c294dc432ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc432f8 expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.164354:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f600, rc 0) 00000100:00100000:3.0:1787864688.164445:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844808704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.164453:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787864688.164533:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.164677:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.164688:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864688.164843:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.165117:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.165158:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864688.165204:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808832 00000100:00100000:1.0:1787864688.165288:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808832 00000100:00100000:1.0:1787864688.165335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787864688.165344:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844808832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864688.165499:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844808832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864688.165507:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787864688.165791:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.165839:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.165980:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.169606:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844808960 00000100:00100000:1.0:1787864688.169626:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844808960 00000100:00100000:1.0:1787864688.169702:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787864688.169724:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844808960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864688.169940:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844808960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864688.169949:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787864688.170001:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.170033:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844808960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.170566:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10350:1874711844809088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.170624:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.170652:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.171452:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809088 00000100:00100000:3.0:1787864688.171463:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809088 00000100:00100000:3.0:1787864688.171527:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787864688.171539:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:10350:x1874711844809088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.171704:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:10350:x1874711844809088:12345-0@lo:502:llog_process_th.0 Request processed in 167us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.171722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787864688.175397:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10350:1874711844809088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864688.175457:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864688.175470:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864688.175472:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787864688.175478:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787864688.175547:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10350:1874711844809216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864688.175647:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.175704:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01300 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.175991:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809216 00000100:00100000:3.0:1787864688.175999:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809216 00000100:00100000:3.0:1787864688.176062:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787864688.176073:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:10350:x1874711844809216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.176248:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:10350:x1874711844809216:12345-0@lo:502:llog_process_th.0 Request processed in 177us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.176258:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787864688.176277:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10350:1874711844809216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864688.176300:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864688.176306:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864688.176308:0:10350:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787864688.176312:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1787864688.176494:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787864688.176517:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787864688.176531:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.176671:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864688.176684:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787864688.176687:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927547df8000 from 48 10000000:01000000:0.0:1787864688.176690:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864688.176795:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.176804:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.176815:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864688.176835:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.176873:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.177084:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.177123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809344 00000100:00100000:2.0:1787864688.177130:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809344 00000100:00100000:2.0:1787864688.177169:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787864688.177176:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:6508:x1874711844809344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864688.177187:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864688.177203:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797800/0x2fcb8c294dc4330d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43306 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.177230:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797800/0x2fcb8c294dc4330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43306 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.177242:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797800/0x2fcb8c294dc4330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43306 expref: 20 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.177265:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797800, rc 0) 00000100:00100000:2.0:1787864688.177328:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.177335:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787864688.177421:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.177435:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.177445:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864688.177513:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.177786:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.177813:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.177825:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809472 00000100:00100000:3.0:1787864688.177830:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809472 00000100:00100000:3.0:1787864688.177872:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787864688.177881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864688.178062:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.178069:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787864688.178074:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.178112:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.178154:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.178177:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.178263:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809600 00000100:00100000:3.0:1787864688.178267:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809600 00000100:00100000:3.0:1787864688.178352:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787864688.178359:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864688.178489:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.178496:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787864688.180161:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.180455:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10351:1874711844809728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.180530:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.180573:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809728 00000100:00100000:2.0:1787864688.180579:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809728 00000100:00100000:2.0:1787864688.180623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787864688.180634:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:10351:x1874711844809728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.180800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:10351:x1874711844809728:12345-0@lo:502:llog_process_th.0 Request processed in 167us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.180812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787864688.180860:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.180873:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10351:1874711844809728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.180934:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10351:1874711844809856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.180968:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.180991:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809856 00000100:00100000:2.0:1787864688.180994:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809856 00000100:00100000:2.0:1787864688.181009:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787864688.181015:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:10351:x1874711844809856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.181067:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:10351:x1874711844809856:12345-0@lo:502:llog_process_th.0 Request processed in 52us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.181079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787864688.181104:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.181113:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10351:1874711844809856:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787864688.181132:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787864688.181187:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787864688.181207:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864688.181217:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181230:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.181240:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787864688.181243:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787864688.181245:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787864688.181270:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181278:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181287:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.181298:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181321:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.181331:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.181341:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844809984 00000100:00100000:2.0:1787864688.181348:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844809984 00000100:00100000:2.0:1787864688.181362:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787864688.181366:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844809984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864688.181387:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864688.181399:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446796800/0x2fcb8c294dc4331b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43314 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181420:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446796800/0x2fcb8c294dc4331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43314 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181431:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446796800/0x2fcb8c294dc4331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43314 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181440:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796800, rc 0) 00000100:00100000:2.0:1787864688.181463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844809984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.181469:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787864688.181491:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844809984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864688.181501:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.181510:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.181550:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181570:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.181581:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.181590:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810112 00000100:00100000:2.0:1787864688.181598:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810112 00000100:00100000:2.0:1787864688.181613:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787864688.181617:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844810112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844810112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.181720:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787864688.181745:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181770:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181805:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.181818:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.181829:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810240 00000100:00100000:2.0:1787864688.181832:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810240 00000100:00100000:2.0:1787864688.181847:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787864688.181852:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844810240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.181942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844810240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.181948:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787864688.181983:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.186714:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10352:1874711844810368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.186840:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.186909:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.186998:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810368 00000100:00100000:2.0:1787864688.187006:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810368 00000100:00100000:2.0:1787864688.187056:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787864688.187064:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10352:x1874711844810368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.187443:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10352:x1874711844810368:12345-0@lo:502:llog_process_th.0 Request processed in 378us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.187497:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787864688.188009:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10352:1874711844810368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864688.188054:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864688.188069:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864688.188073:0:10352:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787864688.188201:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787864688.188298:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10352:1874711844810496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.188351:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.188406:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864688.197168:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810496 00000100:00100000:3.0:1787864688.197189:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810496 00000100:00100000:2.0:1787864688.197477:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787864688.197490:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10352:x1874711844810496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.197725:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10352:x1874711844810496:12345-0@lo:502:llog_process_th.0 Request processed in 237us (9372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.197734:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787864688.197763:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10352:1874711844810496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864688.197819:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864688.197828:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864688.197831:0:10352:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787864688.197836:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787864688.197984:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787864688.198007:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787864688.198018:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.198031:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.198042:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787864688.198045:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff927548600000 from 48 10000000:01000000:2.0:1787864688.198048:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864688.198086:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.198095:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.198105:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.198130:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.198172:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.198215:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.198444:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810624 00000100:00100000:0.0:1787864688.198460:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810624 00000100:00100000:0.0:1787864688.198502:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787864688.198510:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844810624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.198521:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864688.198536:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30c00/0x2fcb8c294dc43329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43322 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.198560:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30c00/0x2fcb8c294dc43329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43322 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.198572:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30c00/0x2fcb8c294dc43329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43322 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.198582:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30c00, rc 0) 00000100:00100000:0.0:1787864688.198623:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844810624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.198630:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787864688.198665:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.198679:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.198689:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864688.200971:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.201060:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.201120:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.201286:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810752 00000100:00100000:2.0:1787864688.201301:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810752 00000100:00100000:2.0:1787864688.201359:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787864688.201379:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844810752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.201701:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844810752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.201734:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.201795:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.201838:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787864688.201838:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.202066:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70000 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.204678:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844810880 00000100:00100000:2.0:1787864688.204696:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844810880 00000100:00100000:2.0:1787864688.205690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787864688.205707:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844810880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.205955:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844810880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.205964:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787864688.207271:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844810880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.210250:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10354:1874711844811008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.210352:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.210415:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.210468:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811008 00000100:00100000:2.0:1787864688.210476:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811008 00000100:00100000:2.0:1787864688.210533:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787864688.210552:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10354:x1874711844811008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864688.210847:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10354:x1874711844811008:12345-0@lo:502:llog_process_th.0 Request processed in 296us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.210856:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787864688.210997:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10354:1874711844811008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.211056:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10354:1874711844811136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864688.211096:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864688.211132:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.211677:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811136 00000100:00100000:0.0:1787864688.211684:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811136 00000100:00100000:0.0:1787864688.211735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787864688.211745:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10354:x1874711844811136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.211849:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10354:x1874711844811136:12345-0@lo:502:llog_process_th.0 Request processed in 105us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.211857:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787864688.212231:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10354:1874711844811136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787864688.212259:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787864688.212594:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787864688.212619:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787864688.212631:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.212643:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.212668:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787864688.212671:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1787864688.212674:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787864688.212837:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.212849:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.212860:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.212883:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.212968:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.212994:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811264 00000100:00100000:0.0:1787864688.212999:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811264 00000100:00100000:2.0:1787864688.213003:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.213042:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787864688.213051:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844811264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.213063:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864688.213079:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31e00/0x2fcb8c294dc43337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43330 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.213105:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31e00/0x2fcb8c294dc43337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43330 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.213117:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31e00/0x2fcb8c294dc43337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43330 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.213133:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31e00, rc 0) 00000100:00100000:0.0:1787864688.213182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.213188:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787864688.213257:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864688.213273:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.213283:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.213342:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.213368:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.213397:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.213439:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811392 00000100:00100000:0.0:1787864688.213443:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811392 00000100:00100000:0.0:1787864688.213473:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787864688.213481:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.214941:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1450us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.214956:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787864688.217857:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.218096:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864688.218202:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.218287:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.220170:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811520 00000100:00100000:0.0:1787864688.220190:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811520 00000100:00100000:0.0:1787864688.220267:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787864688.220281:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.220533:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.220542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787864688.220745:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864688.222121:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10356:1874711844811648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864688.222215:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.222267:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.222315:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811648 00000100:00100000:0.0:1787864688.222322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811648 00000100:00100000:0.0:1787864688.222387:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787864688.222398:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10356:x1874711844811648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864688.222551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10356:x1874711844811648:12345-0@lo:502:llog_process_th.0 Request processed in 154us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.222559:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787864688.222740:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10356:1874711844811648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864688.222773:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864688.222784:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864688.222787:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787864688.222793:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787864688.222819:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10356:1874711844811776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864688.222855:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864688.224793:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864688.225014:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811776 00000100:00100000:1.0:1787864688.225026:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811776 00000100:00100000:1.0:1787864688.225102:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787864688.225112:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10356:x1874711844811776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864688.225317:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10356:x1874711844811776:12345-0@lo:502:llog_process_th.0 Request processed in 205us (2460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864688.225326:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787864688.225433:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10356:1874711844811776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864688.225470:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864688.225479:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864688.225481:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787864688.225486:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787864688.226782:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1787864688.226819:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787864688.226833:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.226847:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864688.226875:0:6508:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787864688.227088:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92755ed9ced8 from 1 10000000:01000000:3.0:1787864688.227093:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787864688.227134:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.227144:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.227155:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.227181:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864688.227249:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864688.227346:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864688.228641:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844811904 00000100:00100000:1.0:1787864688.228683:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844811904 00000100:00100000:1.0:1787864688.228755:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787864688.228766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844811904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864688.228784:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864688.228805:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948600/0x2fcb8c294dc43345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4333e expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.228839:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948600/0x2fcb8c294dc43345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4333e expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.229322:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948600/0x2fcb8c294dc43345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4333e expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864688.229334:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948600, rc 0) 00000100:00100000:1.0:1787864688.229839:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844811904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1072us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.230006:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844811904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864688.230031:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.230043:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864688.230128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787864688.230142:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844812032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.230191:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.230236:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864688.230261:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812032 00000100:00100000:0.0:1787864688.230266:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812032 00000100:00100000:0.0:1787864688.230305:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787864688.230314:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844812032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864688.230416:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844812032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (226us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864688.230423:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787864688.230515:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844812032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787864688.230548:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787864688.230555:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864688.230564:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787864688.670125:0:10386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc181b7fc0 20000000:00000080:3.0:1787864688.670147:0:10386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff927448255c00 uarg=0000000000000000 20000000:01000000:3.0:1787864688.670201:0:10386:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787864688.670208:0:10386:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787864688.670214:0:10386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787864688.670866:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1787864688.671152:0:10386:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787864688.678345:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787864688.678462:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787864688.678485:0:10386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787864688.678504:0:10386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864688.678529:0:10386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678551:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678573:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678580:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678587:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678598:0:10386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678607:0:10386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678654:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678670:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 9 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.678687:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812160:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864688.678870:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.678879:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 23 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.678937:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812288:0@lo:104: 00000100:00100000:3.0:1787864688.678995:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864688.679041:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.679050:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 23 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.679058:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812416:0@lo:104: 00000100:00100000:3.0:1787864688.679082:0:10386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864688.679107:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.679115:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 23 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.679123:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812544:0@lo:104: 00010000:00010000:3.0:1787864688.679147:0:10386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.679154:0:10386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 23 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.679162:0:10386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812672:0@lo:104: 00000100:00100000:3.0:1787864688.679179:0:10386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864688.680514:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787864688.680553:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.680579:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.680590:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812288 00000100:00100000:2.0:1787864688.680598:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812288 00000100:00100000:2.0:1787864688.680646:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812416 00000100:00100000:2.0:1787864688.680650:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812416 00000100:00100000:2.0:1787864688.680662:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812544 00000100:00100000:2.0:1787864688.680665:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812544 00000100:00100000:2.0:1787864688.680675:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812672 00000100:00100000:2.0:1787864688.680678:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812672 00000100:00100000:2.0:1787864688.680692:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787864688.680702:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:10386:x1874711844812288:12345-0@lo:104: 00010000:00010000:2.0:1787864688.680720:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.680796:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864688.680802:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:10386:x1874711844812288:12345-0@lo:104: Request processed in 102us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.680810:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787864688.680827:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864688.680833:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:10386:x1874711844812416:12345-0@lo:104: 00010000:00010000:2.0:1787864688.680842:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.680878:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864688.680883:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:10386:x1874711844812416:12345-0@lo:104: Request processed in 50us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.680926:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864688.680963:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864688.680970:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10386:x1874711844812544:12345-0@lo:104: 00010000:00010000:2.0:1787864688.680977:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681014:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787864688.681019:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:10386:x1874711844812544:12345-0@lo:104: Request processed in 51us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.681025:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864688.681036:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864688.681042:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10386:x1874711844812672:12345-0@lo:104: 00010000:00010000:2.0:1787864688.681049:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681088:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787864688.681094:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:10386:x1874711844812672:12345-0@lo:104: Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.681099:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787864688.681119:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787864688.681126:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681133:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582172600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864688.681137:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681156:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864688.681162:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.681167:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864688.681206:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681213:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864688.681238:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681246:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582172600/0x2fcb8c294dc43169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43170 expref: -99 pid: 9502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681261:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787864688.681264:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681270:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864688.681274:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681280:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864688.681286:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.681297:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864688.681312:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681316:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864688.681333:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681340:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc43043 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4304a expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681349:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864688.681352:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681357:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864688.681360:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681380:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864688.681387:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.681391:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864688.681699:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681708:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864688.681724:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681731:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173800/0x2fcb8c294dc42fef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42ff6 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681743:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864688.681747:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681752:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864688.681755:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681763:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864688.681770:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864688.681775:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864688.681787:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681792:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864688.681799:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681805:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc42fe1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc42fe8 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.681819:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864688.681827:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864688.681829:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864688.681838:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864688.681847:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864688.681855:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864688.681876:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844812800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.681956:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.682004:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864688.682012:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844813184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682036:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.682072:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844812928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682095:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.682113:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864688.682118:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844813056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864688.682185:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812800 00000100:00100000:2.0:1787864688.682192:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812800 00010000:00010000:2.0:1787864688.682222:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 24 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.682243:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813184 00000100:00100000:2.0:1787864688.682246:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813184 00010000:00010000:2.0:1787864688.682256:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 25 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.682265:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844812928 00000100:00100000:2.0:1787864688.682267:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844812928 00010000:00010000:2.0:1787864688.682276:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 26 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.682298:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813056 00000100:00100000:2.0:1787864688.682301:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813056 00010000:00010000:2.0:1787864688.682312:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 27 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.682324:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864688.682332:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+27:3640:x1874711844812800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864688.682346:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864688.682352:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 27 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682362:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 27 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682473:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864688.682515:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+27:3640:x1874711844812800:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.682522:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787864688.682540:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864688.682546:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3640:x1874711844813184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864688.682553:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864688.682557:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 26 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682565:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 26 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682575:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864688.682604:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3640:x1874711844813184:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.682610:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787864688.682622:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787864688.682628:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3637:x1874711844812928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864688.682635:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864688.682639:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 25 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682647:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 25 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682656:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864688.682678:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3637:x1874711844812928:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.682684:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787864688.682697:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787864688.682702:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844813056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864688.682709:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864688.682714:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 24 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682721:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 24 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.682731:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864688.682752:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844813056:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864688.682757:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787864688.682833:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844813056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682842:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844812928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844813184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864688.682875:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844812800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864688.683209:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030600/0x2fcb8c294dc43170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43169 expref: 23 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.683224:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812288:0@lo:104: 00010000:00010000:2.0:1787864688.683236:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797a00/0x2fcb8c294dc4304a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43043 expref: 22 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.683243:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812416:0@lo:104: 00010000:00010000:2.0:1787864688.683254:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387aa00/0x2fcb8c294dc42ff6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42fef expref: 21 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.683265:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812544:0@lo:104: 00010000:00010000:2.0:1787864688.683277:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582173a00/0x2fcb8c294dc42fe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc42fe1 expref: 20 pid: 6504 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.683286:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812672:0@lo:104: 00000100:00100000:1.0:1787864688.693690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864688.695217:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881472 00000100:00100000:3.0:1787864688.695236:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881472 00010000:00010000:3.0:1787864688.695294:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 10 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864688.695337:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:3.0:1787864688.695376:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825881472:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864688.695403:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864688.695410:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 10 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695424:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 10 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695452:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695462:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695484:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695492:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695499:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695506:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695512:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864688.695517:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695527:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695546:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864688.695558:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864688.695634:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825881472:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 270us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864688.695643:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 39 00010000:00010000:2.0:1787864688.698128:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43288 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac80c expref: 9 pid: 6504 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.698155:0:10386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10386:1874711844812160:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864688.698203:0:10386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.698237:0:10386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.698245:0:10386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864688.698251:0:10386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824ee00/0x2fcb8c294dc4334c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864688.921280:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844813312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864688.921387:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864688.921594:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813312 00000100:00100000:0.0:1787864688.921604:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813312 00000100:00100000:0.0:1787864688.921678:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787864688.921688:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844813312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864688.921731:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864688.921833:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844813312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864688.921841:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787864688.922022:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844813312:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864688.985516:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864689.433328:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864689.433361:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844813440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864689.433575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864689.433983:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864689.433998:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844813568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864689.434035:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864689.434230:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813440 00000100:00100000:1.0:1787864689.434239:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813440 00000100:00100000:1.0:1787864689.434312:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813568 00000100:00100000:1.0:1787864689.434315:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813568 00000100:00100000:1.0:1787864689.434335:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864689.434346:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844813440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864689.434394:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864689.434447:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844813440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.434455:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864689.434491:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864689.434497:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844813568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864689.434507:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864689.434534:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844813568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.434540:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787864689.434604:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864689.434637:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d4b40 x1874711844813568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864689.434657:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844813568:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787864689.434743:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc17840 x1874711844813440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864689.434758:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844813440:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1787864689.881162:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864689.881172:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757de48800 from 4 10000000:01000000:1.0:1787864689.881179:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864689.881237:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.881252:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.881266:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864689.881300:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.881395:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864689.881464:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.881563:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813696 00000100:00100000:0.0:1787864689.881572:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813696 00000100:00100000:0.0:1787864689.881641:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787864689.881651:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844813696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864689.881667:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864689.881684:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43353 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.881709:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.881721:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 21 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.881731:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30200, rc 0) 00000100:00100000:0.0:1787864689.881801:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844813696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.881809:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787864689.881930:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864689.881947:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864689.881956:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864689.882032:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.882062:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.882085:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.882142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813824 00000100:00100000:1.0:1787864689.882147:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813824 00000100:00100000:1.0:1787864689.882185:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787864689.882192:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844813824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.882325:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844813824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.882332:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787864689.882415:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.882458:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.882511:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.882530:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.882612:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844813952 00000100:00100000:1.0:1787864689.882617:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844813952 00000100:00100000:1.0:1787864689.882647:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787864689.882654:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844813952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.882738:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844813952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.882745:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787864689.882823:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844813952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.883189:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10442:1874711844814080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864689.883228:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.883253:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275429a1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.883339:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814080 00000100:00100000:0.0:1787864689.883343:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814080 00000100:00100000:0.0:1787864689.883386:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787864689.883393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10442:x1874711844814080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.883496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10442:x1874711844814080:12345-0@lo:502:llog_process_th.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.883503:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787864689.883635:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10442:1874711844814080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864689.883661:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864689.883672:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864689.883675:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787864689.883683:0:10442:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92757de48800 00000020:00000080:2.0:1787864689.883686:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787864689.883774:0:10442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10442:1874711844814208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864689.883807:0:10442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.883831:0:10442:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ece840 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.883877:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814208 00000100:00100000:1.0:1787864689.883882:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814208 00000100:00100000:1.0:1787864689.883937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787864689.883944:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10442:x1874711844814208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864689.884014:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:10442:x1874711844814208:12345-0@lo:502:llog_process_th.0 Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.884021:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787864689.884154:0:10442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10442:1874711844814208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864689.884172:0:10442:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864689.884177:0:10442:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864689.884178:0:10442:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787864689.884182:0:10442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787864689.884345:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787864689.884377:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864689.884388:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.884399:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864689.884410:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864689.884413:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757bdea800 from 4 10000000:01000000:1.0:1787864689.884417:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864689.885541:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.885560:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.885579:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864689.885603:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.885666:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864689.885699:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.885731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814336 00000100:00100000:1.0:1787864689.885737:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814336 00000100:00100000:1.0:1787864689.885786:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787864689.885795:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844814336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864689.885809:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864689.885825:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43361 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.885851:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.885861:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.885871:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949a00, rc 0) 00000100:00100000:1.0:1787864689.885925:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.885932:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787864689.885980:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864689.885997:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864689.886012:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864689.886077:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.886104:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864689.886118:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.886129:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814464 00000100:00100000:1.0:1787864689.886132:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814464 00000100:00100000:1.0:1787864689.886153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787864689.886159:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.886271:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.886278:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787864689.886308:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.886333:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.886385:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864689.886398:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864689.886408:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814592 00000100:00100000:1.0:1787864689.886411:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814592 00000100:00100000:1.0:1787864689.886430:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787864689.891074:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864689.891309:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4871us (4921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864689.891320:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787864689.899236:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.901348:0:10445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10445:1874711844814720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.902037:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.902132:0:10445:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744815d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864689.902224:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814720 00000100:00100000:3.0:1787864689.902238:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814720 00000100:00100000:3.0:1787864689.902328:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787864689.902345:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10445:x1874711844814720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864689.902559:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10445:x1874711844814720:12345-0@lo:502:llog_process_th.0 Request processed in 218us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864689.902571:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787864689.903234:0:10445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10445:1874711844814720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864689.903295:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864689.903315:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864689.903320:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787864689.903332:0:10445:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92757bdea800 00000020:00000080:0.0:1787864689.903336:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787864689.905120:0:10445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10445:1874711844814848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.905218:0:10445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.905271:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814848 00000100:00100000:0.0:1787864689.905278:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814848 00000100:00100000:0.0:1787864689.905335:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787864689.905343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10445:x1874711844814848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.907106:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:10445:x1874711844814848:12345-0@lo:502:llog_process_th.0 Request processed in 1752us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.907135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787864689.907221:0:10445:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744815d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.907509:0:10445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10445:1874711844814848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864689.907551:0:10445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864689.907562:0:10445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864689.907564:0:10445:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787864689.907570:0:10445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787864689.908607:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787864689.908640:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864689.908654:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864689.908667:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864689.908697:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787864689.908700:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927547df8000 from 4 10000000:01000000:2.0:1787864689.908703:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864689.908751:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864689.908760:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864689.908770:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864689.908798:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.909966:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.910015:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.915551:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844814976 00000100:00100000:0.0:1787864689.915573:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844814976 00000100:00100000:0.0:1787864689.915649:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787864689.915660:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844814976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864689.915681:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864689.915707:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4336f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.915740:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.915753:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.915764:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31400, rc 0) 00000100:00100000:0.0:1787864689.915866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844814976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (5904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.915874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787864689.916006:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844814976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864689.916029:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.916049:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864689.916143:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.916182:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.916217:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.916232:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815104 00000100:00100000:0.0:1787864689.921555:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815104 00000100:00100000:0.0:1787864689.921645:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787864689.921656:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844815104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.927522:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844815104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5855us (11326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.927542:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787864689.927668:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.927746:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.927820:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.927873:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.927949:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815232 00000100:00100000:0.0:1787864689.927956:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815232 00000100:00100000:0.0:1787864689.928006:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787864689.928017:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844815232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.928142:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844815232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.928149:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787864689.928217:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.928511:0:10448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10448:1874711844815360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.928554:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.928574:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815360 00000100:00100000:0.0:1787864689.928578:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815360 00000100:00100000:0.0:1787864689.928602:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787864689.928609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10448:x1874711844815360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.928690:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10448:x1874711844815360:12345-0@lo:502:llog_process_th.0 Request processed in 82us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.928698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787864689.928738:0:10448:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744815d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.928750:0:10448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10448:1874711844815360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864689.928775:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864689.928787:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864689.928790:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787864689.928798:0:10448:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff927547df8000 00000020:00000080:0.0:1787864689.928800:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787864689.929281:0:10448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10448:1874711844815488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.929330:0:10448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.929358:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815488 00000100:00100000:0.0:1787864689.929376:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815488 00000100:00100000:0.0:1787864689.929410:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787864689.929419:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10448:x1874711844815488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.929501:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:10448:x1874711844815488:12345-0@lo:502:llog_process_th.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.929508:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787864689.929558:0:10448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.929573:0:10448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10448:1874711844815488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864689.929594:0:10448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864689.929601:0:10448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864689.929603:0:10448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787864689.929607:0:10448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787864689.929674:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787864689.929696:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864689.929709:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.929723:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864689.929736:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864689.929740:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927548600000 from 4 10000000:01000000:0.0:1787864689.929743:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864689.929773:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.929782:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.929792:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864689.929808:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.929838:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.929853:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.929867:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815616 00000100:00100000:0.0:1787864689.929878:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815616 00000100:00100000:0.0:1787864689.929934:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787864689.929942:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844815616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864689.929951:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864689.929966:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4337d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.929990:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.930001:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.930012:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30800, rc 0) 00000100:00100000:0.0:1787864689.930045:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844815616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.930052:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787864689.930088:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864689.930101:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864689.930111:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864689.936062:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.936156:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864689.936203:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.936242:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815744 00000100:00100000:0.0:1787864689.936255:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815744 00000100:00100000:0.0:1787864689.936305:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787864689.936315:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844815744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864689.938257:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844815744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1932us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.938272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787864689.940238:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.940338:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.940465:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.940513:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ece480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864689.943778:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844815872 00000100:00100000:2.0:1787864689.943796:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844815872 00000100:00100000:2.0:1787864689.943885:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787864689.943914:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844815872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.944127:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844815872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864689.944136:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787864689.944222:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844815872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864689.953773:0:10451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10451:1874711844816000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864689.953906:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.953966:0:10451:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568ecec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.954081:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816000 00000100:00100000:0.0:1787864689.954090:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816000 00000100:00100000:0.0:1787864689.954156:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787864689.954167:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:10451:x1874711844816000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.954312:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:10451:x1874711844816000:12345-0@lo:502:llog_process_th.0 Request processed in 146us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.954320:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787864689.958794:0:10451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10451:1874711844816000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864689.958853:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864689.958866:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864689.958869:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787864689.958877:0:10451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff927548600000 00000020:00000080:2.0:1787864689.958880:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787864689.959049:0:10451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10451:1874711844816128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864689.959142:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864689.959188:0:10451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274482836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864689.960817:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816128 00000100:00100000:0.0:1787864689.960832:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816128 00000100:00100000:0.0:1787864689.960925:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787864689.960937:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:10451:x1874711844816128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864689.961116:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:10451:x1874711844816128:12345-0@lo:502:llog_process_th.0 Request processed in 180us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864689.961124:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787864689.962594:0:10451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:10451:1874711844816128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864689.962644:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864689.962655:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864689.962657:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787864689.962663:0:10451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787864689.962847:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787864689.962873:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864689.962901:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864689.962914:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864690.012984:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864690.397121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864690.400188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881600 00000100:00100000:2.0:1787864690.400210:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881600 00000100:00100000:2.0:1787864690.400694:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 270 00000100:00100000:2.0:1787864690.400705:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:6199:x1874711825881600:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864690.400722:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864690.400740:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac852 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864690.400768:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864690.400779:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864690.400790:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:2.0:1787864690.400913:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825881600:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 210us (3799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864690.400921:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 270 00000100:00100000:3.0:1787864690.404384:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864690.404658:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881728 00000100:00100000:2.0:1787864690.404666:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881728 00000100:00100000:2.0:1787864690.404717:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 271 00000100:00100000:2.0:1787864690.404726:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825881728:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864690.404852:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825881728:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 126us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864690.404859:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 271 00000100:00100000:3.0:1787864690.406567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864690.406643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881856 00000100:00100000:2.0:1787864690.406649:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881856 00000100:00100000:2.0:1787864690.406681:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 272 00000100:00100000:2.0:1787864690.406688:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825881856:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864690.406798:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6199:x1874711825881856:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 110us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864690.406806:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 272 00000100:00100000:2.0:1787864690.423011:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864690.423083:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825881984 00000100:00100000:0.0:1787864690.423092:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825881984 00000100:00100000:0.0:1787864690.423142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 273 00000100:00100000:0.0:1787864690.423150:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6738:x1874711825881984:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864690.423279:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6738:x1874711825881984:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864690.423294:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 273 00000100:00100000:0.0:1787864690.436005:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864690.436182:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882112 00000100:00100000:2.0:1787864690.436190:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882112 00000100:00100000:2.0:1787864690.436242:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 274 00000100:00100000:2.0:1787864690.436252:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6738:x1874711825882112:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864690.436409:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:6738:x1874711825882112:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 158us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864690.437006:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 274 00000100:00100000:2.0:1787864690.458315:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864690.458338:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844816256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864690.458414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864690.458522:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816256 00000100:00100000:3.0:1787864690.458532:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816256 00000100:00100000:3.0:1787864690.458592:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864690.458603:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844816256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864690.458638:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787864690.458697:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844816256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864690.458705:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864690.460846:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844816256:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864691.054395:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864692.057160:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864692.839459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864692.839497:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864692.839550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864692.839576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864692.839599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864692.839626:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882624 00000100:00100000:1.0:1787864692.839634:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882624 00000100:00100000:1.0:1787864692.839683:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882752 00000100:00100000:1.0:1787864692.839687:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882752 00000100:00100000:1.0:1787864692.839706:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864692.839716:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882624:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864692.839780:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882624:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 65us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864692.839787:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864692.839802:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864692.839808:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882752:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864692.839830:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882752:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864692.839837:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00080000:1.0:1787864692.839852:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864692.839856:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864692.840002:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882240 00000100:00100000:1.0:1787864692.840006:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882240 00000100:00100000:1.0:1787864692.840031:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 275 00000100:00100000:1.0:1787864692.840037:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825882240:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864692.840063:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825882240:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864692.840081:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 275 00000100:00100000:3.0:1787864692.841492:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882368 00000100:00100000:3.0:1787864692.841516:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882368 00000100:00100000:3.0:1787864692.841578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882496 00000100:00100000:3.0:1787864692.841582:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882496 00000100:00100000:3.0:1787864692.841607:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:3.0:1787864692.841616:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825882368:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864692.841666:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825882368:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 52us (2216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864692.841674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:3.0:1787864692.841688:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:3.0:1787864692.841695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882496:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864692.841717:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825882496:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864692.841723:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00080000:1.0:1787864692.842208:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864692.842213:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864693.017220:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864693.017241:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844816384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864693.017301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864693.017366:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816384 00000100:00100000:0.0:1787864693.017372:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816384 00000100:00100000:0.0:1787864693.017670:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864693.017681:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844816384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864693.017708:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864693.017750:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844816384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864693.017757:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787864693.017777:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787864693.017805:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa7840 x1874711844816384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864693.017823:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844816384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864693.020082:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844816512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864693.020146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864693.020213:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816512 00000100:00100000:3.0:1787864693.020219:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816512 00000100:00100000:3.0:1787864693.020268:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864693.020277:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844816512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864693.020296:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864693.020336:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844816512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864693.020357:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787864693.020392:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447fc6940 x1874711844816512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864693.020423:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844816512:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787864693.021113:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864693.024616:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844816640:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.024679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864693.026034:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816640 00000100:00100000:2.0:1787864693.026044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816640 00000100:00100000:2.0:1787864693.026092:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787864693.026100:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844816640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.026339:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844816768:0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.026386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864693.026416:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864693.026423:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844816896:0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.026447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864693.033478:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816768 00000100:00100000:1.0:1787864693.033490:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816768 00000100:00100000:1.0:1787864693.033610:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864693.033619:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844816768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.033701:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844816768:12345-0@lo:400:kworker.0 Request processed in 83us (7314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864693.033708:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864693.033749:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844816768:0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.033784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844816896 00000100:00100000:1.0:1787864693.033788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844816896 00000100:00100000:1.0:1787864693.033813:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864693.033819:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844816896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.033854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844816896:12345-0@lo:400:kworker.0 Request processed in 35us (7406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864693.033860:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864693.033880:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844817024:0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.033989:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864693.034039:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844816896:0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.034067:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817024 00000100:00100000:1.0:1787864693.034071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817024 00000100:00100000:1.0:1787864693.034092:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864693.034098:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844817024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864693.034130:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844817024:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864693.034136:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864693.034157:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844817024:0@lo:400:kworker.0 00000100:00100000:2.0:1787864693.035535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844816640:12345-0@lo:400:kworker.0 Request processed in 9430us (10850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864693.035547:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787864693.039053:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844816640:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045070:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844817280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864693.045188:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817280 00000100:00100000:0.0:1787864693.045195:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817280 00000100:00100000:0.0:1787864693.045253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864693.045264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844817280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045316:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844817280:12345-0@lo:400:kworker.0 Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864693.045332:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787864693.045374:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864693.045413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844817280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045454:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844817408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864693.045518:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817408 00000100:00100000:0.0:1787864693.045522:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817408 00000100:00100000:0.0:1787864693.045550:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787864693.045557:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844817408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045591:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844817408:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864693.045597:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787864693.045610:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787864693.045630:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa70c0 x1874711844817408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864693.045640:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844817408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045683:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844817792:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045705:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864693.045733:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817792 00000100:00100000:0.0:1787864693.045737:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817792 00000100:00100000:0.0:1787864693.045764:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787864693.045769:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844817792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844817792:12345-0@lo:400:kworker.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864693.045825:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1787864693.045844:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864693.045862:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844817792:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.045926:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844817920:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046224:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844817152:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046259:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864693.046284:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844817664:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864693.046327:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864693.046332:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844817536:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864693.046407:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817152 00000100:00100000:3.0:1787864693.046412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817152 00000100:00100000:3.0:1787864693.046441:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787864693.046448:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844817152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046496:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844817152:12345-0@lo:400:kworker.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864693.046513:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787864693.046533:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817664 00000100:00100000:3.0:1787864693.046536:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817664 00000100:00100000:3.0:1787864693.046563:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817536 00000100:00100000:3.0:1787864693.046565:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817536 00000100:00100000:3.0:1787864693.046584:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864693.046590:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844817664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046621:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844817664:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864693.046627:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864693.046638:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787864693.046645:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844817536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046670:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844817536:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864693.046676:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787864693.046696:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864693.046721:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa70c0 x1874711844817536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864693.046731:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844817536:0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.046741:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844817152:0@lo:400:kworker.0 00010000:00080000:3.0:1787864693.046750:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa7c00 x1874711844817664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864693.046758:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844817664:0@lo:400:kworker.0 00000100:00100000:0.0:1787864693.048572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864693.048825:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844817920 00000100:00100000:3.0:1787864693.048832:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844817920 00000100:00100000:3.0:1787864693.048905:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864693.048915:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844817920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864693.048971:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844817920:12345-0@lo:400:kworker.0 Request processed in 58us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864693.048978:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1787864693.050339:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa61c0 x1874711844817920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864693.050366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844817920:0@lo:400:kworker.0 00000100:00080000:0.0:1787864693.050393:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1787864693.095428:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864694.042623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864694.042647:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844818048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864694.042712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864694.042844:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818048 00000100:00100000:3.0:1787864694.042850:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818048 00000100:00100000:3.0:1787864694.042917:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787864694.043047:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844818048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864694.043078:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864694.043168:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844818048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864694.043176:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787864694.043291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489ba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844818048:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864694.105007:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864694.553153:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864694.553282:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844818176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864694.553354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864694.553462:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818176 00000100:00100000:1.0:1787864694.553470:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818176 00000100:00100000:1.0:1787864694.553521:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864694.553531:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844818176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864694.553557:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864694.553600:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844818176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864694.553608:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787864694.553642:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc14b40 x1874711844818176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864694.553659:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844818176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864694.554039:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844818304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864694.554070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864694.554143:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818304 00000100:00100000:2.0:1787864694.554147:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818304 00000100:00100000:2.0:1787864694.554179:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864694.554186:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844818304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864694.554196:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864694.554227:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844818304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864694.554233:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787864694.554256:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d6580 x1874711844818304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864694.554269:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844818304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864695.131490:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787864695.379509:0:10686:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1787864695.577749:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844818432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864695.577813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864695.577882:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818432 00000100:00100000:1.0:1787864695.577912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818432 00000100:00100000:1.0:1787864695.577957:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864695.577972:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844818432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864695.578005:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787864695.578048:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844818432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864695.578055:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864695.578096:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844818432:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787864696.153655:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864697.177070:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864697.974599:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864697.974638:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864697.974665:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864697.974687:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864697.974714:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864697.974744:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825882880 00000100:00100000:1.0:1787864697.974752:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825882880 00000100:00100000:1.0:1787864697.974800:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 277 00000100:00100000:1.0:1787864697.974821:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825882880:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864697.974909:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2410:x1874711825882880:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864697.974917:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 277 00000100:00100000:1.0:1787864697.974948:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883008 00000100:00100000:1.0:1787864697.974951:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883008 00000100:00100000:1.0:1787864697.975304:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883136 00000100:00100000:1.0:1787864697.975308:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883136 00000100:00100000:1.0:1787864697.975345:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:1.0:1787864697.975353:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825883008:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864697.975458:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825883008:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 105us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864697.975476:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:1.0:1787864697.975491:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 74 00000100:00100000:1.0:1787864697.975497:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825883136:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864697.975525:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825883136:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 28us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864697.975531:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 74 00000100:00100000:1.0:1787864697.975732:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883264 00000100:00100000:1.0:1787864697.975736:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883264 00000100:00100000:1.0:1787864697.975766:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883392 00000100:00100000:1.0:1787864697.975769:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883392 00000100:00100000:1.0:1787864697.981196:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864697.981229:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825883264:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864697.981305:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825883264:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 95us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864697.981313:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864697.981355:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:1.0:1787864697.981363:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825883392:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864697.981398:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825883392:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 36us (6683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864697.981405:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00080000:1.0:1787864697.982198:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864697.982203:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864697.982206:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864697.982208:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864698.137086:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864698.137114:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864698.137180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864698.137184:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864698.137194:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844818688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864698.137220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.137245:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818560 00000100:00100000:1.0:1787864698.137252:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818560 00000100:00100000:1.0:1787864698.137308:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818688 00000100:00100000:1.0:1787864698.137312:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818688 00000100:00100000:1.0:1787864698.137344:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864698.137352:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844818560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864698.137389:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864698.137431:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844818560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864698.137439:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864698.137455:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864698.137462:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844818688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864698.137472:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864698.137664:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844818688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864698.137672:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787864698.137714:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927446fa61c0 x1874711844818688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864698.137732:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844818688:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787864698.137842:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787864698.137972:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92744884b480 x1874711844818560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864698.137989:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864698.143543:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844818816:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.143642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.143694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844819328:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.143722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.143754:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844819840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.143777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864698.144023:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818816 00000100:00100000:2.0:1787864698.144031:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818816 00000100:00100000:2.0:1787864698.144075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787864698.144084:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844818816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864698.144132:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844818816:12345-0@lo:400:kworker.0 Request processed in 49us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864698.144138:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787864698.144222:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819328 00000100:00100000:0.0:1787864698.144227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819328 00000100:00100000:0.0:1787864698.144262:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787864698.144269:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.144305:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844819328:12345-0@lo:400:kworker.0 Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.144333:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787864698.144491:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787864698.144504:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844818944:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.144535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.144627:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844819456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.144655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.144672:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844819968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.144692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.144716:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844818816:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.144726:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844819328:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.144758:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819840 00000100:00100000:1.0:1787864698.144761:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819840 00000100:00100000:1.0:1787864698.144797:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864698.145016:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844818944 00000100:00100000:0.0:1787864698.145021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844818944 00000100:00100000:0.0:1787864698.145055:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819456 00000100:00100000:0.0:1787864698.145058:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819456 00000100:00100000:0.0:1787864698.145078:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819968 00000100:00100000:0.0:1787864698.145081:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819968 00000100:00100000:0.0:1787864698.145096:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787864698.145102:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.145155:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844818944:12345-0@lo:400:kworker.0 Request processed in 53us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.145162:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787864698.145176:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787864698.145183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844819456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.145210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844819456:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.145216:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787864698.145227:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787864698.145233:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844819968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.145259:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844819968:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.145265:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864698.145962:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844819840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146009:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844819840:12345-0@lo:400:kworker.0 Request processed in 1205us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864698.146015:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787864698.146052:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864698.146057:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864698.146070:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844819072:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146112:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.146132:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844819584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146153:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.146171:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844820096:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.146209:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787864698.146215:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844819200:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146235:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.146249:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844819712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.146267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864698.146291:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819584 00000100:00100000:1.0:1787864698.146295:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819584 00000100:00100000:2.0:1787864698.146505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820096 00000100:00100000:2.0:1787864698.146509:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820096 00000100:00100000:2.0:1787864698.146541:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819200 00000100:00100000:2.0:1787864698.146544:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819200 00000100:00100000:2.0:1787864698.146580:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864698.146587:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844820096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864698.146629:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844820096:12345-0@lo:400:kworker.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864698.146635:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864698.146647:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787864698.146654:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844819200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864698.146680:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844819200:12345-0@lo:400:kworker.0 Request processed in 27us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864698.146686:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787864698.147015:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819072 00000100:00100000:0.0:1787864698.147020:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819072 00000100:00100000:0.0:1787864698.147046:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787864698.147052:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844819072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.147087:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844819072:12345-0@lo:400:kworker.0 Request processed in 36us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.147093:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787864698.149505:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844819712 00000100:00100000:0.0:1787864698.149517:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844819712 00000100:00100000:0.0:1787864698.149592:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864698.149601:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864698.149675:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844819712:12345-0@lo:400:kworker.0 Request processed in 75us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864698.149698:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787864698.150527:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864698.150533:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864698.150580:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844819200:0@lo:400:kworker.0 00010000:00080000:1.0:1787864698.150595:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d61c0 x1874711844819712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864698.150606:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844819712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.150618:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844819072:0@lo:400:kworker.0 00010000:00080000:1.0:1787864698.150629:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448187c00 x1874711844820096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864698.150637:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844820096:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.150712:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787864698.150721:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844819584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.150798:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844819584:12345-0@lo:400:kworker.0 Request processed in 78us (4643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864698.151749:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844818944:0@lo:400:kworker.0 00000100:00100000:2.0:1787864698.151763:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844819456:0@lo:400:kworker.0 00000100:00100000:2.0:1787864698.151774:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844819968:0@lo:400:kworker.0 00010000:00080000:2.0:1787864698.151788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558999e00 x1874711844819840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864698.151797:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558999e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844819840:0@lo:400:kworker.0 00010000:00080000:0.0:1787864698.152569:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d4b40 x1874711844819584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864698.152581:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844819584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864698.152766:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:1.0:1787864698.201009:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864699.161141:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864699.161162:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844820224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864699.161229:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864699.161366:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820224 00000100:00100000:3.0:1787864699.161373:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820224 00000100:00100000:3.0:1787864699.161425:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787864699.161434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844820224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864699.161478:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864699.161539:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844820224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864699.161546:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787864699.161687:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844820224:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864699.226279:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864699.673073:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844820352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864699.673141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864699.674525:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820352 00000100:00100000:0.0:1787864699.674535:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820352 00000100:00100000:0.0:1787864699.674580:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787864699.674589:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844820352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864699.674616:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864699.674671:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844820352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864699.674689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787864699.674743:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448186d00 x1874711844820352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864699.674760:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844820352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864699.679064:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844820480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864699.679126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864699.685697:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820480 00000100:00100000:0.0:1787864699.685709:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820480 00000100:00100000:0.0:1787864699.685774:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864699.685784:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844820480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864699.685951:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864699.692187:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844820480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6395us (13050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864699.692214:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1787864699.692548:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b92c0 x1874711844820480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864699.692581:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844820480:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787864700.249098:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864700.698832:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844820608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864700.699001:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864700.699073:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820608 00000100:00100000:2.0:1787864700.699080:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820608 00000100:00100000:2.0:1787864700.699121:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787864700.699129:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844820608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864700.699160:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864700.699201:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844820608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864700.699208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787864700.699250:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844820608:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787864701.124529:0:10929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing yml_node 00010000:00010000:2.0:1787864701.278555:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864702.302045:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864703.082808:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864703.082849:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864703.082884:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864703.083137:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883776 00000100:00100000:0.0:1787864703.083146:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883776 00000100:00100000:0.0:1787864703.083211:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883648 00000100:00100000:0.0:1787864703.083215:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883648 00000100:00100000:0.0:1787864703.083249:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:0.0:1787864703.083259:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825883776:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864703.083340:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825883776:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 82us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.083348:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:0.0:1787864703.083367:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 82 00000100:00100000:0.0:1787864703.083374:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825883648:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864703.083412:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825883648:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 39us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.083418:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 82 00000100:00100000:1.0:1787864703.083670:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883520 00000100:00100000:1.0:1787864703.083676:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883520 00000100:00100000:1.0:1787864703.083721:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 279 00000100:00100000:1.0:1787864703.083729:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825883520:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864703.083757:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825883520:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864703.083763:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 279 00000100:00080000:3.0:1787864703.086635:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864703.086644:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864703.087862:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864703.088026:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825883904 00000100:00100000:2.0:1787864703.088035:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825883904 00000100:00100000:2.0:1787864703.088105:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:2.0:1787864703.088115:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825883904:12345-192.168.206.36@tcp:9:kworker.0 00000020:00000080:2.0:1787864703.088151:0:8820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4329d 00000100:00080000:2.0:1787864703.088160:0:8820:0:(import.c:65:import_set_state_nolock()) ffff927447ea8800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864703.088208:0:8820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787864703.088374:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+2:2406:x1874711825883904:12345-192.168.206.36@tcp:9:kworker.0 Request processed in 260us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.088382:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00010000:00010000:0.0:1787864703.088592:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864703.089124:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864703.098518:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864703.098714:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884032 00000100:00100000:0.0:1787864703.098723:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884032 00000100:00100000:0.0:1787864703.098791:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:0.0:1787864703.098801:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825884032:12345-192.168.206.36@tcp:9:kworker.0 00000020:00000080:0.0:1787864703.098837:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc432a4 00000100:00080000:0.0:1787864703.098846:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92757fad1800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787864703.099102:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864703.099155:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1787864703.099206:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1787864703.099375:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+2:2406:x1874711825884032:12345-192.168.206.36@tcp:9:kworker.0 Request processed in 575us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.099407:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:2.0:1787864703.257426:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844820736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257498:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257548:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844821248:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257598:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844821760:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257630:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844822272:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257645:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257665:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787864703.257670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844821120:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257701:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844821632:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257729:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844822144:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257765:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844820992:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257796:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844821504:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844822016:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257850:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257867:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787864703.257872:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844820864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257944:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844821376:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.257963:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.257977:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844821888:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864703.258021:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821248 00000100:00100000:2.0:1787864703.258026:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821248 00000100:00100000:2.0:1787864703.258060:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820992 00000100:00100000:2.0:1787864703.258063:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820992 00000100:00100000:2.0:1787864703.258076:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787864703.258083:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844821248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258126:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844821248:12345-0@lo:400:kworker.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258133:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787864703.258147:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787864703.258153:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844820992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258183:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844820992:12345-0@lo:400:kworker.0 Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258189:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787864703.258210:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821120 00000100:00100000:2.0:1787864703.258213:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821120 00000100:00100000:2.0:1787864703.258242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821504 00000100:00100000:2.0:1787864703.258245:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821504 00000100:00100000:2.0:1787864703.258267:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822016 00000100:00100000:2.0:1787864703.258269:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822016 00000100:00100000:2.0:1787864703.258280:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820864 00000100:00100000:2.0:1787864703.258282:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820864 00000100:00100000:2.0:1787864703.258303:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821376 00000100:00100000:2.0:1787864703.258306:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821376 00000100:00100000:2.0:1787864703.258317:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821888 00000100:00100000:2.0:1787864703.258319:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821888 00000100:00100000:2.0:1787864703.258333:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787864703.258337:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844821120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258378:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558999e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844821120:12345-0@lo:400:kworker.0 Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258385:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787864703.258396:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864703.258402:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844821504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844821504:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258438:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864703.258448:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787864703.258454:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844822016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258467:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844820736 00000100:00100000:0.0:1787864703.258472:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844820736 00000100:00100000:2.0:1787864703.258478:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844822016:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787864703.258493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787864703.258494:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787864703.258498:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844820864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258499:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844820736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258523:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844820864:12345-0@lo:400:kworker.0 Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.258525:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844820736:12345-0@lo:400:kworker.0 Request processed in 27us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258528:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787864703.258531:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787864703.258538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787864703.258543:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844821376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258573:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821760 00000100:00100000:0.0:1787864703.258577:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821760 00000100:00100000:2.0:1787864703.258578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844821376:12345-0@lo:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258583:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787864703.258593:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822272 00000100:00100000:2.0:1787864703.258594:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787864703.258596:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822272 00000100:00100000:2.0:1787864703.258599:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844821888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258605:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844821632 00000100:00100000:0.0:1787864703.258607:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844821632 00000100:00100000:0.0:1787864703.258616:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822144 00000100:00100000:0.0:1787864703.258618:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822144 00000100:00100000:0.0:1787864703.258630:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864703.258631:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844821888:12345-0@lo:400:kworker.0 Request processed in 31us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.258635:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844821760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258637:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787864703.258658:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864703.258661:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864703.258661:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844821760:12345-0@lo:400:kworker.0 Request processed in 26us (1044us total) trans 0 rc 0/0 00000100:00080000:2.0:1787864703.258664:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864703.258666:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864703.258666:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864703.258676:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864703.258681:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844822272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258688:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844820864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258699:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844821376:0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258704:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844822272:12345-0@lo:400:kworker.0 Request processed in 24us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864703.258707:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844821888:0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258709:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864703.258716:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844820992:0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258719:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787864703.258726:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c92d00 x1874711844821504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864703.258730:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844821632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258736:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844821504:0@lo:400:kworker.0 00010000:00080000:2.0:1787864703.258745:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc7840 x1874711844822016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864703.258754:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844822016:0@lo:400:kworker.0 00000100:00100000:0.0:1787864703.258754:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844821632:12345-0@lo:400:kworker.0 Request processed in 25us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.258760:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787864703.258769:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864703.258774:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844822144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258788:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844821120:0@lo:400:kworker.0 00010000:00080000:2.0:1787864703.258798:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90000 x1874711844821632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864703.258798:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844822144:12345-0@lo:400:kworker.0 Request processed in 23us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.258803:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787864703.258806:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844821632:0@lo:400:kworker.0 00010000:00080000:2.0:1787864703.258815:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc6580 x1874711844822144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864703.258829:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844822144:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258838:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844820736:0@lo:400:kworker.0 00000100:00100000:2.0:1787864703.258847:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844821248:0@lo:400:kworker.0 00010000:00080000:2.0:1787864703.258856:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c921c0 x1874711844821760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864703.258862:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844821760:0@lo:400:kworker.0 00010000:00080000:2.0:1787864703.258871:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc61c0 x1874711844822272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864703.258877:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844822272:0@lo:400:kworker.0 00000100:00100000:1.0:1787864703.259974:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864703.260058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864703.260121:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864703.260131:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844822528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864703.260157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864703.260256:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822400 00000100:00100000:0.0:1787864703.260264:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822400 00000100:00100000:0.0:1787864703.260315:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822528 00000100:00100000:0.0:1787864703.260318:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822528 00000100:00100000:0.0:1787864703.260332:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864703.260339:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844822400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864703.260363:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864703.260417:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844822400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.260425:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787864703.260439:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787864703.260448:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844822528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864703.260458:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864703.260483:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844822528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864703.260488:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787864703.260579:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc5e00 x1874711844822528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864703.260596:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844822528:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787864703.260606:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b8780 x1874711844822400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864703.260626:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844822400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787864703.321102:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864704.284265:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844822656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864704.284368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864704.284606:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822656 00000100:00100000:1.0:1787864704.284615:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822656 00000100:00100000:1.0:1787864704.284689:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864704.284701:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844822656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864704.284742:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864704.290758:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844822656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6045us (6376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864704.290775:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787864704.299782:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844822656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864704.345281:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864704.793376:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844822784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864704.793999:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844822912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864704.794079:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864704.794234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864704.794623:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822912 00000100:00100000:3.0:1787864704.794633:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822912 00000100:00100000:3.0:1787864704.794697:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844822784 00000100:00100000:3.0:1787864704.794701:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844822784 00000100:00100000:3.0:1787864704.794720:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864704.794731:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844822912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864704.794785:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864704.794869:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844822912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864704.794878:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864704.794939:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864704.794946:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844822784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864704.794957:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864704.794995:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844822784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864704.795020:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787864704.795272:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc86d00 x1874711844822784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864704.795308:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844822784:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787864704.795847:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489bb480 x1874711844822912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864704.795864:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844822912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787864705.369151:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864705.819488:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844823040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864705.819583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864705.819700:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823040 00000100:00100000:3.0:1787864705.819709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823040 00000100:00100000:3.0:1787864705.819772:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787864705.819783:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844823040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864705.819828:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787864705.823854:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844823040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4061us (4260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864705.823872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864705.827662:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844823040:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787864706.188849:0:11113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:0.0:1787864706.396816:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864707.417394:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864708.194274:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864708.194321:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864708.194389:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864708.194426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884160 00000100:00100000:2.0:1787864708.194442:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884160 00000100:00100000:2.0:1787864708.194491:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 281 00000100:00100000:2.0:1787864708.194501:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825884160:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864708.194566:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825884160:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 66us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.194574:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 281 00000100:00100000:3.0:1787864708.197148:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884288 00000100:00100000:3.0:1787864708.197160:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884288 00000100:00100000:3.0:1787864708.197244:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884416 00000100:00100000:3.0:1787864708.197248:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884416 00000100:00100000:3.0:1787864708.197280:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 89 00000100:00100000:3.0:1787864708.197289:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825884288:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864708.197357:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825884288:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 69us (3036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.197365:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 89 00000100:00100000:3.0:1787864708.197381:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 90 00000100:00100000:3.0:1787864708.197388:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825884416:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864708.197414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825884416:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 26us (3025us total) trans 0 rc 0/0 00000100:00080000:0.0:1787864708.197582:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864708.197587:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864708.200234:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 90 00000100:00100000:0.0:1787864708.378307:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844823168:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378374:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378418:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844823680:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378459:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378482:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824192:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378526:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824704:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378548:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378570:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787864708.378576:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844823296:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378626:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844823808:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378663:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844824320:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378724:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844823424:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378765:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844823936:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378784:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378801:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844824448:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378834:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787864708.378840:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844823552:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864708.378870:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844824064:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.378907:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864708.379100:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823296 00000100:00100000:2.0:1787864708.379106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823296 00000100:00100000:2.0:1787864708.379149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823808 00000100:00100000:2.0:1787864708.379152:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823808 00000100:00100000:2.0:1787864708.379174:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824320 00000100:00100000:2.0:1787864708.379176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824320 00000100:00100000:2.0:1787864708.379189:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823936 00000100:00100000:2.0:1787864708.379191:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823936 00000100:00100000:2.0:1787864708.379202:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824448 00000100:00100000:2.0:1787864708.379204:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824448 00000100:00100000:2.0:1787864708.379214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823552 00000100:00100000:2.0:1787864708.379216:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823552 00000100:00100000:2.0:1787864708.379229:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864708.379236:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844823296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379301:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448116580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844823296:12345-0@lo:400:kworker.0 Request processed in 65us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379309:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864708.379324:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864708.379330:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844823808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379356:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844823808:12345-0@lo:400:kworker.0 Request processed in 27us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379362:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864708.379384:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787864708.379390:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844824320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379419:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448115e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844824320:12345-0@lo:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379424:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787864708.379436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787864708.379442:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844823936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379468:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844823936:12345-0@lo:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787864708.379485:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864708.379490:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844824448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844824448:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379522:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864708.379533:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787864708.379538:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844823552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844823552:12345-0@lo:400:kworker.0 Request processed in 24us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.379567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1787864708.379583:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864708.379587:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864708.379616:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844823296:0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379627:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844823808:0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.379637:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844824320:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.380026:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844824576:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.380059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787864708.380091:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc6d00 x1874711844823936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864708.380103:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844823936:0@lo:400:kworker.0 00010000:00080000:0.0:1787864708.380113:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc6580 x1874711844824448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864708.381570:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824192 00000100:00100000:3.0:1787864708.381580:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824192 00000100:00100000:3.0:1787864708.381622:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824704 00000100:00100000:3.0:1787864708.381626:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824704 00000100:00100000:3.0:1787864708.381637:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824064 00000100:00100000:3.0:1787864708.381639:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824064 00000100:00100000:3.0:1787864708.381651:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824576 00000100:00100000:3.0:1787864708.381653:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824576 00000100:00100000:3.0:1787864708.381668:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787864708.381675:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.381740:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824192:12345-0@lo:400:kworker.0 Request processed in 65us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.381747:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787864708.381761:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864708.381768:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757e007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.381797:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757e007850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824704:12345-0@lo:400:kworker.0 Request processed in 31us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.381803:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864708.381958:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787864708.381966:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844824064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.381995:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844824064:12345-0@lo:400:kworker.0 Request processed in 31us (3108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.382003:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787864708.382014:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864708.382020:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.382059:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844824576:12345-0@lo:400:kworker.0 Request processed in 39us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.382064:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864708.382086:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823680 00000100:00100000:3.0:1787864708.382090:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823680 00000100:00100000:3.0:1787864708.382112:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823424 00000100:00100000:3.0:1787864708.382115:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823424 00000100:00100000:3.0:1787864708.382127:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787864708.382133:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844823680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.382164:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844823680:12345-0@lo:400:kworker.0 Request processed in 32us (3706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.382169:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787864708.382179:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787864708.382184:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844823424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.382211:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844823424:12345-0@lo:400:kworker.0 Request processed in 27us (3463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.382215:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787864708.382233:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844823168 00000100:00100000:3.0:1787864708.382236:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844823168 00000100:00100000:3.0:1787864708.382257:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787864708.382275:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844823168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864708.382306:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844823168:12345-0@lo:400:kworker.0 Request processed in 43us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864708.382312:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787864708.382569:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844824448:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.382604:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844823552:0@lo:400:kworker.0 00010000:00080000:0.0:1787864708.382615:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc52c0 x1874711844824064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864708.382636:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844824064:0@lo:400:kworker.0 00010000:00080000:0.0:1787864708.382650:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc7840 x1874711844824576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864708.382658:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844824576:0@lo:400:kworker.0 00000100:00100000:0.0:1787864708.382668:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844823424:0@lo:400:kworker.0 00000100:00080000:2.0:1787864708.383010:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864708.383015:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864708.383037:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844823168:0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.383050:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844823680:0@lo:400:kworker.0 00010000:00080000:2.0:1787864708.383062:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc5e00 x1874711844824192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864708.383070:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824192:0@lo:400:kworker.0 00010000:00080000:2.0:1787864708.383080:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc4000 x1874711844824704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864708.383088:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824704:0@lo:400:kworker.0 00000100:00100000:2.0:1787864708.383572:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864708.383586:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864708.383630:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864708.383666:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824832 00000100:00100000:2.0:1787864708.383671:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824832 00000100:00100000:2.0:1787864708.383709:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787864708.383717:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864708.383741:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864708.383780:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844824832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864708.383786:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787864708.383817:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc87840 x1874711844824832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864708.383831:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844824832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864708.384046:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864708.384057:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844824960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864708.384086:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864708.384282:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844824960 00000100:00100000:1.0:1787864708.384286:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844824960 00000100:00100000:1.0:1787864708.384427:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787864708.384436:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844824960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864708.384448:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864708.384484:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844824960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864708.384490:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787864708.385995:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448117480 x1874711844824960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864708.386018:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448117480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844824960:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787864708.442735:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864708.718434:0:11211:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000001:00100000:2.0:1787864708.894946:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:2.0:1787864708.894955:0:9504:0:(genops.c:885:class_export_put()) final put ffff92757fad4800/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:0.0:1787864708.897328:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fad4800/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-OST0001 00000020:00000080:0.0:1787864708.897380:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757fad1800 for lustre-OST0001 00000001:00100000:1.0:1787864708.901601:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:1.0:1787864708.901610:0:8419:0:(genops.c:885:class_export_put()) final put ffff927447eaa000/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:2.0:1787864708.901710:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eaa000/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-OST0000 00000020:00000080:2.0:1787864708.901766:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447ea8800 for lustre-OST0000 00000100:00100000:2.0:1787864709.402438:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844825088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864709.402620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864709.402760:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825088 00000100:00100000:1.0:1787864709.402767:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825088 00000100:00100000:1.0:1787864709.402828:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787864709.402837:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844825088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864709.402868:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864709.403152:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844825088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 315us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864709.403166:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787864709.403222:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844825088:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864709.466728:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864709.913277:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844825216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864709.913346:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864709.914284:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825216 00000100:00100000:2.0:1787864709.914294:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825216 00000100:00100000:2.0:1787864709.914355:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787864709.914365:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844825216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864709.914396:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864709.914471:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448116940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844825216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864709.914479:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787864709.914563:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc85e00 x1874711844825216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864709.914583:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844825216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864709.916566:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844825344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864709.916625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864709.916748:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825344 00000100:00100000:0.0:1787864709.916754:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825344 00000100:00100000:0.0:1787864709.916802:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864709.916812:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844825344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864709.916830:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864709.917273:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844825344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 462us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864709.917297:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787864709.917350:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b8000 x1874711844825344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864709.917367:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844825344:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787864710.489274:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864710.945632:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844825472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864710.945707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864710.945836:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825472 00000100:00100000:1.0:1787864710.945845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825472 00000100:00100000:1.0:1787864710.945926:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787864710.945936:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844825472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864710.945968:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787864710.946013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844825472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864710.946019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787864710.946415:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844825472:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787864711.307513:0:11308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00010000:00010000:2.0:1787864711.514148:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864712.537587:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864713.039726:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 17:05:11 EDT 2026 00000100:00100000:2.0:1787864713.317758:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864713.317877:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864713.319267:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884672 00000100:00100000:3.0:1787864713.319284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884672 00000100:00100000:3.0:1787864713.319381:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:3.0:1787864713.319394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825884672:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864713.319503:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825884672:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 112us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.319512:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00080000:2.0:1787864713.320165:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864713.325319:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884544 00000100:00100000:0.0:1787864713.325341:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884544 00000100:00100000:3.0:1787864713.325526:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 283 00000100:00100000:3.0:1787864713.325539:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825884544:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864713.325652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825884544:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 115us (7910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.325660:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 283 00000100:00100000:2.0:1787864713.347526:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864713.347628:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884800 00000100:00100000:3.0:1787864713.347640:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884800 00000100:00100000:3.0:1787864713.347727:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00100000:3.0:1787864713.347739:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825884800:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864713.347837:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825884800:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.347846:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00080000:2.0:1787864713.348130:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787864713.497257:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864713.497286:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864713.497380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.497485:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825600 00000100:00100000:2.0:1787864713.497493:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825600 00000100:00100000:2.0:1787864713.497561:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787864713.497574:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844825600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864713.497611:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864713.497665:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844825600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864713.497674:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787864713.497965:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864713.497986:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844825984:0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.498023:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844825728:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498048:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.498069:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864713.498087:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844826496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.498103:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844826240:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.498138:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787864713.498164:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc84780 x1874711844825600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864713.498165:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844826752:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498191:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864713.498199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.498223:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787864713.498229:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844825856:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498251:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844827008:0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.498268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.498293:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844826368:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864713.498327:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864713.498333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787864713.498342:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844826112:0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.498358:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844826880:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864713.498390:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844826624:0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.498409:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825984 00000100:00100000:3.0:1787864713.498416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864713.498429:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825984 00000100:00100000:3.0:1787864713.498437:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844827136:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498464:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864713.498476:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826240 00000100:00100000:1.0:1787864713.498481:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826240 00000100:00100000:3.0:1787864713.498502:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826752 00000100:00100000:1.0:1787864713.498503:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787864713.498508:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826752 00000100:00100000:1.0:1787864713.498514:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844825984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498547:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826624 00000100:00100000:3.0:1787864713.498551:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826624 00000100:00100000:3.0:1787864713.498567:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827136 00000100:00100000:3.0:1787864713.498570:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827136 00000100:00100000:3.0:1787864713.498589:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864713.498595:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844825984:12345-0@lo:400:kworker.0 Request processed in 81us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.498599:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844826752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.498608:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787864713.498627:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864713.498636:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844826240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.498645:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844826752:12345-0@lo:400:kworker.0 Request processed in 48us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.498657:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787864713.498673:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864713.498691:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844826624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.498697:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844826240:12345-0@lo:400:kworker.0 Request processed in 61us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864713.498706:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864713.498731:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826496 00000100:00100000:3.0:1787864713.498735:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844826624:12345-0@lo:400:kworker.0 Request processed in 44us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864713.498736:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826496 00000100:00100000:2.0:1787864713.498744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864713.498749:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787864713.498761:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825856 00000100:00100000:1.0:1787864713.498764:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825856 00000100:00100000:3.0:1787864713.498771:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864713.498778:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827008 00000100:00100000:2.0:1787864713.498781:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844826240:0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.498783:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827008 00000100:00100000:3.0:1787864713.498784:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844827136:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787864713.498797:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc7c00 x1874711844826752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864713.498808:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844826752:0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.498815:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826368 00000100:00100000:1.0:1787864713.498819:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826368 00000100:00100000:3.0:1787864713.498827:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844827136:12345-0@lo:400:kworker.0 Request processed in 47us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.498835:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787864713.498857:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864713.498860:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864713.498862:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864713.498864:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864713.498951:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844825728 00000100:00100000:2.0:1787864713.498955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844825728 00000100:00100000:2.0:1787864713.499000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787864713.499009:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844825728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.499016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826112 00000100:00100000:3.0:1787864713.499022:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826112 00000100:00100000:3.0:1787864713.499043:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844826880 00000100:00100000:3.0:1787864713.499046:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844826880 00000100:00100000:2.0:1787864713.499052:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844825728:12345-0@lo:400:kworker.0 Request processed in 44us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864713.499060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787864713.499072:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787864713.499080:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844826496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.499107:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864713.499109:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844825728:0@lo:400:kworker.0 00000100:00100000:1.0:1787864713.499117:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844825856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.499127:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844826496:12345-0@lo:400:kworker.0 Request processed in 47us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.499136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864713.499155:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864713.499164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.499198:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844827008:12345-0@lo:400:kworker.0 Request processed in 36us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864713.499221:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844825856:12345-0@lo:400:kworker.0 Request processed in 47us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864713.499366:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864713.499385:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844827264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864713.499431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864713.499467:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827264 00000100:00100000:0.0:1787864713.499472:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827264 00000100:00100000:0.0:1787864713.499500:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864713.499512:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844827264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864713.499527:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864713.499573:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448116d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844827264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864713.499584:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864713.502152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787864713.502182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844826368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.502327:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844826368:12345-0@lo:400:kworker.0 Request processed in 160us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.502336:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787864713.502388:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787864713.502396:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844826112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.502444:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844826112:12345-0@lo:400:kworker.0 Request processed in 49us (4074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.502450:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787864713.502464:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787864713.502471:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.502506:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844826880:12345-0@lo:400:kworker.0 Request processed in 35us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864713.502512:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787864713.502540:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864713.502763:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844825856:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.502778:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844826368:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.502796:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844826880:0@lo:400:kworker.0 00010000:00080000:3.0:1787864713.502960:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448115680 x1874711844827264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864713.502982:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844827264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864713.506994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844826112:0@lo:400:kworker.0 00010000:00080000:3.0:1787864713.507058:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc6940 x1874711844826624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864713.507075:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844826624:0@lo:400:kworker.0 00010000:00080000:3.0:1787864713.507091:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc52c0 x1874711844827136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864713.507127:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844827136:0@lo:400:kworker.0 00010000:00080000:3.0:1787864713.507145:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc7840 x1874711844827008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864713.507153:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844827008:0@lo:400:kworker.0 00000100:00100000:3.0:1787864713.507168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844825984:0@lo:400:kworker.0 00010000:00080000:3.0:1787864713.507192:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc5e00 x1874711844826496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864713.507202:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844826496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864713.507644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787864713.507679:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:0.0:1787864713.561688:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864714.524367:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864714.524453:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844827392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864714.524593:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864714.524760:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827392 00000100:00100000:1.0:1787864714.524769:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827392 00000100:00100000:1.0:1787864714.524848:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787864714.524859:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844827392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864714.524918:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864714.524977:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844827392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864714.524985:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787864714.525605:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844827392:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864714.585427:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864715.037662:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864715.037684:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864715.037759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864715.037822:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827520 00000100:00100000:0.0:1787864715.037829:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827520 00000100:00100000:0.0:1787864715.037881:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787864715.037912:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844827520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864715.037940:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864715.037985:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844827520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864715.038005:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787864715.038027:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787864715.038055:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448115680 x1874711844827520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864715.038073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448115680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864715.038488:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864715.038501:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844827648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864715.038533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864715.038590:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827648 00000100:00100000:2.0:1787864715.038596:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827648 00000100:00100000:2.0:1787864715.038634:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864715.038642:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844827648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864715.038653:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864715.038686:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844827648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864715.038692:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787864715.038730:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc7480 x1874711844827648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787864715.038818:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864715.039069:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844827648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787864715.610270:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864716.059737:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844827776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864716.059800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864716.060562:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827776 00000100:00100000:1.0:1787864716.060571:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827776 00000100:00100000:1.0:1787864716.060621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864716.060630:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844827776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864716.060662:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787864716.060728:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844827776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864716.060736:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787864716.061050:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844827776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864716.633263:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864717.347827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864717.347937:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864717.347977:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864717.348005:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885184 00000100:00100000:0.0:1787864717.348014:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885184 00000100:00100000:0.0:1787864717.348083:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885056 00000100:00100000:0.0:1787864717.348086:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885056 00000100:00100000:0.0:1787864717.348111:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 105 00000100:00100000:0.0:1787864717.348121:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825885184:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864717.348200:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448115680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825885184:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864717.348208:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 105 00000100:00100000:0.0:1787864717.348240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 106 00000100:00100000:0.0:1787864717.348247:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825885056:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864717.348273:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825885056:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864717.348280:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 106 00000100:00080000:3.0:1787864717.348942:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864717.348947:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864717.349670:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825884928 00000100:00100000:1.0:1787864717.349678:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825884928 00000100:00100000:1.0:1787864717.349765:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 285 00000100:00100000:1.0:1787864717.349775:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825884928:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864717.349842:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825884928:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 67us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864717.349850:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 285 00010000:00010000:0.0:1787864717.657070:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864718.617176:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844828032:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617305:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844828544:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617348:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844829056:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617395:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787864718.617401:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844828160:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617426:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844828672:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617460:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617471:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844829184:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617486:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864718.617519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828032 00000100:00100000:2.0:1787864718.617525:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828032 00000100:00100000:2.0:1787864718.617559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828544 00000100:00100000:2.0:1787864718.617562:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828544 00000100:00100000:2.0:1787864718.617581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829056 00000100:00100000:2.0:1787864718.617583:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829056 00000100:00100000:2.0:1787864718.617592:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828672 00000100:00100000:2.0:1787864718.617594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828672 00000100:00100000:2.0:1787864718.617603:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829184 00000100:00100000:2.0:1787864718.617604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829184 00000100:00100000:2.0:1787864718.617627:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787864718.617634:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844828032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617686:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844828032:12345-0@lo:400:kworker.0 Request processed in 51us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.617693:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787864718.617708:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787864718.617713:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844828544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617739:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844828544:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.617744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787864718.617753:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787864718.617758:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844829056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617779:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844829056:12345-0@lo:400:kworker.0 Request processed in 21us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.617784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787864718.617793:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787864718.617797:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844828672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617818:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844828672:12345-0@lo:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.617822:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787864718.617830:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787864718.617835:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844829184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617855:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844829184:12345-0@lo:400:kworker.0 Request processed in 20us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.617861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787864718.617884:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828160 00000100:00100000:2.0:1787864718.617923:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828160 00000100:00100000:2.0:1787864718.617951:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864718.617958:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844828160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.617997:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844828160:12345-0@lo:400:kworker.0 Request processed in 39us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.618003:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787864718.618041:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844828160:0@lo:400:kworker.0 00000100:00080000:3.0:1787864718.618051:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787864718.618056:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc4b40 x1874711844828672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864718.618058:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864718.618070:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844828672:0@lo:400:kworker.0 00010000:00080000:2.0:1787864718.618079:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc17840 x1874711844829184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864718.618089:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844829184:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.618102:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844828032:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.618113:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844828544:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.618123:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844829056:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.618157:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844829568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864718.618240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.618255:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844827904:0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.618496:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829568 00000100:00100000:2.0:1787864718.618501:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829568 00000100:00100000:3.0:1787864718.618506:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864718.618515:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844829696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864718.618544:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864718.618552:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844829568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787864718.618573:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864718.621620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.621683:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844828416:0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.621722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.621745:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844828928:0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.621780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.621802:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844829440:0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.621830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864718.621860:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.621865:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787864718.621876:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844828288:0@lo:400:kworker.0 00000100:00080000:3.0:1787864718.621925:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864718.621941:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828416 00000100:00100000:3.0:1787864718.621947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828416 00000100:00100000:3.0:1787864718.621989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864718.621998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844828416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864718.622049:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844828416:12345-0@lo:400:kworker.0 Request processed in 52us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864718.622056:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864718.622077:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828928 00000100:00100000:3.0:1787864718.622081:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828928 00000100:00100000:2.0:1787864718.622098:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844829568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3544us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.622109:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787864718.622111:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829440 00000100:00100000:3.0:1787864718.622115:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829440 00000100:00100000:3.0:1787864718.622135:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864718.622140:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864718.622167:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844828928:12345-0@lo:400:kworker.0 Request processed in 27us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864718.622172:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864718.622181:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787864718.622187:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844829440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864718.622228:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829696 00000100:00100000:2.0:1787864718.622232:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829696 00000100:00100000:3.0:1787864718.622373:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844829440:12345-0@lo:400:kworker.0 Request processed in 185us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864718.622381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864718.622383:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864718.622410:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844828800:0@lo:400:kworker.0 00000100:00080000:3.0:1787864718.622411:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864718.622415:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864718.622474:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864718.622481:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844829696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864718.622496:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1787864718.622572:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b92c0 x1874711844829568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864718.622594:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844829568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864718.622973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.622997:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844829312:0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.623022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864718.623044:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844828416:0@lo:400:kworker.0 00010000:00080000:0.0:1787864718.623055:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc16940 x1874711844828928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864718.623065:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844828928:0@lo:400:kworker.0 00010000:00080000:0.0:1787864718.623076:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc15e00 x1874711844829440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864718.623086:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844829440:0@lo:400:kworker.0 00000100:00100000:3.0:1787864718.623109:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828800 00000100:00100000:3.0:1787864718.623115:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828800 00000100:00100000:3.0:1787864718.623147:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829312 00000100:00100000:3.0:1787864718.623150:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829312 00000100:00100000:3.0:1787864718.623168:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864718.623174:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844828800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864718.623239:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844828800:12345-0@lo:400:kworker.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864718.623246:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864718.623270:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864718.623277:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844829312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864718.623308:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844829312:12345-0@lo:400:kworker.0 Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864718.623316:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787864718.623337:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864718.623337:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844829696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 854us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864718.623348:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787864718.623370:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc4000 x1874711844828800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864718.623381:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844828800:0@lo:400:kworker.0 00010000:00080000:3.0:1787864718.623393:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc14f00 x1874711844829312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864718.623403:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844829312:0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.623408:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844828288 00000100:00100000:0.0:1787864718.623420:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844828288 00010000:00080000:3.0:1787864718.623434:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b9a40 x1874711844829696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864718.623449:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844829696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864718.623497:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787864718.623505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844828288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864718.623556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844828288:12345-0@lo:400:kworker.0 Request processed in 52us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864718.623562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787864718.624937:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844828288:0@lo:400:kworker.0 00000100:00100000:1.0:1787864718.625155:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844827904 00000100:00100000:1.0:1787864718.625161:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844827904 00000100:00100000:1.0:1787864718.625214:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787864718.625223:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844827904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864718.625283:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844827904:12345-0@lo:400:kworker.0 Request processed in 62us (3671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864718.625290:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787864718.625712:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844827904:0@lo:400:kworker.0 00010000:00010000:0.0:1787864718.682932:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864719.641665:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844829824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864719.641728:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864719.643579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829824 00000100:00100000:3.0:1787864719.643590:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829824 00000100:00100000:3.0:1787864719.643645:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864719.643655:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844829824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864719.643687:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864719.643757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844829824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (2029us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864719.643765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864719.643810:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844829824:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787864719.708643:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864720.153075:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844829952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864720.153141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864720.153260:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844829952 00000100:00100000:1.0:1787864720.153266:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844829952 00000100:00100000:1.0:1787864720.153317:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787864720.153334:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844829952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864720.153362:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864720.153405:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844829952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864720.153412:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787864720.153432:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864720.153460:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448849e00 x1874711844829952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864720.153478:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844829952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864720.153760:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864720.153771:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844830080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864720.153800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864720.153834:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830080 00000100:00100000:1.0:1787864720.153838:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830080 00000100:00100000:1.0:1787864720.153867:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787864720.153874:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844830080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864720.153885:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864720.153940:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844830080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864720.153947:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787864720.153961:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864720.153977:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448849e00 x1874711844830080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864720.153990:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844830080:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787864720.730512:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864721.178065:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864721.178086:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844830208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864721.178203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864721.178307:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830208 00000100:00100000:0.0:1787864721.178314:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830208 00000100:00100000:0.0:1787864721.178365:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787864721.178374:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844830208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864721.178404:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787864721.178465:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844830208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864721.178473:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787864721.178559:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844830208:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864721.753302:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864722.525782:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864722.525882:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864722.525945:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864722.526314:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885568 00000100:00100000:3.0:1787864722.526323:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885568 00000100:00100000:3.0:1787864722.526382:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885440 00000100:00100000:3.0:1787864722.526385:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885440 00000100:00100000:3.0:1787864722.526405:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:3.0:1787864722.526571:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825885568:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864722.526647:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825885568:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 233us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864722.526657:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:1.0:1787864722.526662:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885312 00000100:00100000:1.0:1787864722.526678:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885312 00000100:00100000:2.0:1787864722.526680:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 114 00000100:00100000:2.0:1787864722.526698:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825885440:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864722.526714:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 287 00000100:00100000:1.0:1787864722.526724:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825885312:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864722.526734:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825885440:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 38us (786us total) trans 0 rc 0/0 00000100:00080000:0.0:1787864722.526778:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864722.526782:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864722.527220:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825885312:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 495us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864722.527227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 287 00000100:00100000:2.0:1787864722.529797:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 114 00010000:00010000:2.0:1787864722.777537:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864723.737166:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844830464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864723.737166:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844830336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864723.737310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864723.737460:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830464 00000100:00100000:1.0:1787864723.737469:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830464 00000100:00100000:1.0:1787864723.737541:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864723.737555:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844830464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864723.737594:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864723.737987:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844830592:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738094:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844830976:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738159:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844831488:0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.738193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864723.738231:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448865a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844831104:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738240:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844832000:0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.738267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864723.738290:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448864b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844831616:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738304:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787864723.738313:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448865e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844830848:0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.738321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738373:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448867840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844831360:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864723.738414:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844831872:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.738440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864723.738451:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864723.738494:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844830720:0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.738524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864723.738544:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448865680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844831232:0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.738564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864723.738577:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844831744:0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.738596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864723.738617:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830976 00000100:00100000:2.0:1787864723.738629:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830976 00000100:00100000:2.0:1787864723.738662:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831360 00000100:00100000:2.0:1787864723.738664:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831360 00000100:00100000:2.0:1787864723.738680:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831872 00000100:00100000:2.0:1787864723.738682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831872 00000100:00100000:2.0:1787864723.738707:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830720 00000100:00100000:2.0:1787864723.738710:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830720 00000100:00100000:2.0:1787864723.738719:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831232 00000100:00100000:2.0:1787864723.738722:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831232 00000100:00100000:2.0:1787864723.738732:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831744 00000100:00100000:2.0:1787864723.738734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831744 00000100:00100000:2.0:1787864723.738746:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787864723.738753:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844830976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.738795:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844830976:12345-0@lo:400:kworker.0 Request processed in 43us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864723.738803:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787864723.738822:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864723.738827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844831360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.738852:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844831360:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864723.738857:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864723.738867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787864723.738872:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844831872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.738955:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844832128:0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.739209:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864723.739254:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830592 00000100:00100000:0.0:1787864723.739258:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830592 00000100:00100000:0.0:1787864723.739289:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787864723.739296:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844830592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.739303:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844830464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1753us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.739312:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864723.739328:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830336 00000100:00100000:0.0:1787864723.739330:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844830592:12345-0@lo:400:kworker.0 Request processed in 34us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.739331:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830336 00000100:00100000:0.0:1787864723.739336:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787864723.739349:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864723.739355:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844830336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864723.739526:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864723.739566:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844830336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.739572:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787864723.739590:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864723.739595:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864723.739597:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864723.739611:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831488 00000100:00100000:1.0:1787864723.739618:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787864723.739625:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831488 00000100:00100000:1.0:1787864723.739631:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.739680:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844830720:12345-0@lo:400:kworker.0 Request processed in 52us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.739699:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787864723.739706:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832000 00000100:00100000:0.0:1787864723.739712:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832000 00000100:00100000:1.0:1787864723.739725:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787864723.739738:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844831232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.739738:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831616 00000100:00100000:0.0:1787864723.739747:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831616 00000100:00100000:0.0:1787864723.739769:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832128 00000100:00100000:0.0:1787864723.739773:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832128 00000100:00100000:1.0:1787864723.739795:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844831232:12345-0@lo:400:kworker.0 Request processed in 60us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864723.739802:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864723.739809:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787864723.739815:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844831488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.739831:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864723.739839:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844831744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.740867:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844831872:12345-0@lo:400:kworker.0 Request processed in 1986us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864723.740879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844830976:0@lo:400:kworker.0 00000100:00100000:2.0:1787864723.740881:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787864723.740922:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844831488:12345-0@lo:400:kworker.0 Request processed in 1104us (2708us total) trans 0 rc 0/0 00010000:00080000:3.0:1787864723.740931:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448866940 x1874711844831488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864723.740943:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787864723.740953:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844831488:0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.740977:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448849e00 x1874711844830464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864723.740999:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844830464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864723.741001:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864723.741021:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844832000:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.741051:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448867840 x1874711844831360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864723.741081:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448867840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844831360:0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.741104:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdc3c0 x1874711844831872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864723.741117:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844832000:12345-0@lo:400:kworker.0 Request processed in 96us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864723.741124:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844831872:0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.741143:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbde940 x1874711844832000/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864723.741151:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844832000:0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.741520:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844831744:12345-0@lo:400:kworker.0 Request processed in 1680us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.741529:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864723.741562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844831104 00000100:00100000:1.0:1787864723.741569:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844831104 00000100:00100000:1.0:1787864723.741621:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844830848 00000100:00100000:1.0:1787864723.741625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844830848 00000100:00100000:1.0:1787864723.741640:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787864723.741648:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844831104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.741689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844831104:12345-0@lo:400:kworker.0 Request processed in 43us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.741696:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787864723.741710:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787864723.741716:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844830848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.741757:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844830848:12345-0@lo:400:kworker.0 Request processed in 41us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864723.741763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787864723.741813:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864723.741846:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844830720:0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.741879:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448865680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844831232:0@lo:400:kworker.0 00000100:00100000:1.0:1787864723.741907:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844831744:0@lo:400:kworker.0 00010000:00080000:1.0:1787864723.741947:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc86d00 x1874711844830336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864723.741963:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844830336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864723.741989:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864723.742002:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787864723.742004:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448865e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844830848:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.742021:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844831616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.742030:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787864723.742058:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844832128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.742074:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844831616:12345-0@lo:400:kworker.0 Request processed in 59us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864723.742084:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787864723.742340:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844830592:0@lo:400:kworker.0 00000100:00100000:3.0:1787864723.742359:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448865a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844831104:0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.742376:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448864b40 x1874711844831616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864723.742387:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448864b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844831616:0@lo:400:kworker.0 00010000:00080000:3.0:1787864723.742399:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdd680 x1874711844832128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864723.742407:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844832128:0@lo:400:kworker.0 00000100:00100000:0.0:1787864723.744166:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844832128:12345-0@lo:400:kworker.0 Request processed in 103us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864723.744189:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00010000:2.0:1787864723.802444:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864724.763556:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844832256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864724.763647:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864724.763742:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832256 00000100:00100000:1.0:1787864724.763750:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832256 00000100:00100000:1.0:1787864724.763916:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787864724.763928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844832256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864724.763972:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864724.764453:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844832256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 518us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864724.764467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864724.764593:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844832256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787864724.825149:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864725.274470:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844832384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864725.274563:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864725.274677:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832384 00000100:00100000:0.0:1787864725.274686:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832384 00000100:00100000:0.0:1787864725.274756:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787864725.274768:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844832384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864725.274806:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864725.274858:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844832384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.274866:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787864725.274920:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787864725.274960:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdde00 x1874711844832384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864725.274984:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844832384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864725.275272:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864725.275284:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844832512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864725.275331:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864725.275375:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832512 00000100:00100000:2.0:1787864725.275380:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832512 00000100:00100000:2.0:1787864725.275420:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787864725.275429:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844832512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864725.275446:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864725.275484:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844832512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864725.275491:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787864725.275510:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864725.275529:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc14f00 x1874711844832512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864725.275543:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844832512:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787864725.388863:0:11985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:05:24 (1787864724) === 00000100:00100000:0.0:1787864725.733796:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.734129:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885696 00000100:00100000:3.0:1787864725.734139:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885696 00000100:00100000:3.0:1787864725.734207:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 289 00000100:00100000:3.0:1787864725.734221:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:8745:x1874711825885696:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787864725.734236:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864725.734254:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824fa00/0x2fcb8c294dc43392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac859 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.734280:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824fa00/0x2fcb8c294dc43392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac859 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.734292:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824fa00/0x2fcb8c294dc43392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac859 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.734302:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824fa00, rc 0) 00000100:00100000:3.0:1787864725.734512:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825885696:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 293us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.734524:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 289 00000100:00100000:1.0:1787864725.739842:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.740376:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885824 00000100:00100000:3.0:1787864725.740385:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885824 00000100:00100000:3.0:1787864725.740499:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 290 00000100:00100000:3.0:1787864725.740510:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825885824:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787864725.740675:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825885824:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 166us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.740683:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 290 00000100:00100000:1.0:1787864725.745120:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.745230:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825885952 00000100:00100000:3.0:1787864725.745238:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825885952 00000100:00100000:3.0:1787864725.745292:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 291 00000100:00100000:3.0:1787864725.745315:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825885952:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787864725.746012:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825885952:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 696us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.746021:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 291 00000100:00100000:1.0:1787864725.752146:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.752430:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886080 00000100:00100000:0.0:1787864725.752440:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886080 00000100:00100000:0.0:1787864725.752499:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 292 00000100:00100000:0.0:1787864725.752510:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886080:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864725.752810:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886080:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 301us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.752818:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 292 00000100:00100000:1.0:1787864725.774213:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.774299:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886208 00000100:00100000:3.0:1787864725.774307:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886208 00000100:00100000:3.0:1787864725.774357:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 293 00000100:00100000:3.0:1787864725.774366:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886208:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864725.774522:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886208:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.774530:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 293 00000100:00100000:1.0:1787864725.780525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.781366:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886336 00000100:00100000:0.0:1787864725.781380:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886336 00000100:00100000:0.0:1787864725.781453:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 294 00000100:00100000:0.0:1787864725.781465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886336:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864725.781666:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8749:x1874711825886336:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 202us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.781741:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 294 00000100:00100000:0.0:1787864725.785655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.785920:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886464 00000100:00100000:3.0:1787864725.785932:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886464 00000100:00100000:3.0:1787864725.785990:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 295 00000100:00100000:3.0:1787864725.786000:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:8745:x1874711825886464:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787864725.786021:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864725.786043:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc43399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac88a expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.786076:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc43399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac88a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.786088:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc43399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac88a expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864725.786099:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824fc00, rc 0) 00000100:00100000:3.0:1787864725.786379:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:8745:x1874711825886464:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 378us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.786387:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 295 00000100:00100000:1.0:1787864725.789936:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.790054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886592 00000100:00100000:3.0:1787864725.790066:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886592 00000100:00100000:3.0:1787864725.790137:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 296 00000100:00100000:3.0:1787864725.790149:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:8745:x1874711825886592:12345-192.168.206.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787864725.790328:0:6504:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787864725.790419:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787864725.790424:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787864725.790428:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787864725.790431:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787864725.790433:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787864725.793094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:8745:x1874711825886592:12345-192.168.206.36@tcp:256:mount.lustre.0 Request processed in 2932us (3158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.793113:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 296 00000100:00100000:0.0:1787864725.796138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.796398:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886720 00000100:00100000:3.0:1787864725.796409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886720 00000100:00100000:3.0:1787864725.796856:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 297 00000100:00100000:3.0:1787864725.796870:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:8745:x1874711825886720:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787864725.797542:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864725.799144:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac891 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864725.799211:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864725.799227:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864725.799239:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31000, rc 0) 00000100:00100000:0.0:1787864725.799341:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8745:x1874711825886720:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 2465us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.799368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 297 00000100:00100000:1.0:1787864725.802951:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.803547:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886848 00000100:00100000:3.0:1787864725.803561:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886848 00000100:00100000:3.0:1787864725.803866:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 298 00000100:00100000:3.0:1787864725.803878:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8745:x1874711825886848:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787864725.804256:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8745:x1874711825886848:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 378us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.804277:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 298 00000100:00100000:1.0:1787864725.808808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.809058:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825886976 00000100:00100000:0.0:1787864725.809070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825886976 00000100:00100000:0.0:1787864725.809195:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 299 00000100:00100000:0.0:1787864725.809217:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8745:x1874711825886976:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787864725.809688:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8745:x1874711825886976:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 480us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.809703:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 299 00000100:00100000:2.0:1787864725.813031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.813188:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887104 00000100:00100000:0.0:1787864725.813200:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887104 00000100:00100000:0.0:1787864725.813280:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 300 00000100:00100000:0.0:1787864725.813292:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8753:x1874711825887104:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864725.813495:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8753:x1874711825887104:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 205us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.813505:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 300 00000100:00100000:1.0:1787864725.816048:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.816162:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887232 00000100:00100000:0.0:1787864725.816185:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887232 00000100:00100000:0.0:1787864725.816333:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 301 00000100:00100000:0.0:1787864725.816404:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8753:x1874711825887232:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864725.816580:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:8753:x1874711825887232:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 180us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864725.816589:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 301 00000100:00100000:1.0:1787864725.823808:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864725.824121:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864725.824434:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887872 00000100:00100000:2.0:1787864725.824446:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887872 00000100:00100000:2.0:1787864725.824577:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887744 00000100:00100000:2.0:1787864725.824581:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887744 00000100:00100000:1.0:1787864725.824643:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:1.0:1787864725.824656:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825887872:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864725.824752:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825887872:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 100us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864725.824761:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00080000:0.0:1787864725.826189:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864725.826201:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864725.826559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.826603:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.826681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887360 00000100:00100000:3.0:1787864725.826690:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887360 00000100:00100000:3.0:1787864725.826731:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887616 00000100:00100000:3.0:1787864725.826735:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887616 00000100:00100000:3.0:1787864725.826756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:3.0:1787864725.826763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1874711825887360:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787864725.826803:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from d72d3621-0c17-4b0a-8f7a-94eec1706878@192.168.206.36@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787864725.826866:0:6512:0:(genops.c:1385:class_connect()) connect: client d72d3621-0c17-4b0a-8f7a-94eec1706878, cookie 0x2fcb8c294dc433a7 00000004:00100000:3.0:1787864725.826918:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 77 00000100:00080000:3.0:1787864725.827057:0:6512:0:(import.c:65:import_set_state_nolock()) ffff92744839a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864725.827132:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2406:x1874711825887360:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 366us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.827140:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:3.0:1787864725.827160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:3.0:1787864725.827164:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1874711825887616:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787864725.827190:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from d72d3621-0c17-4b0a-8f7a-94eec1706878@192.168.206.36@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787864725.827214:0:6512:0:(genops.c:1385:class_connect()) connect: client d72d3621-0c17-4b0a-8f7a-94eec1706878, cookie 0x2fcb8c294dc433ae 00000004:00100000:3.0:1787864725.827227:0:6512:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 77 00000100:00080000:3.0:1787864725.827286:0:6512:0:(import.c:65:import_set_state_nolock()) ffff92744839d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864725.827312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2406:x1874711825887616:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 146us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.827319:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:2.0:1787864725.829629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:2.0:1787864725.829649:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825887744:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864725.829737:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825887744:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 94us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864725.829745:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:0.0:1787864725.831282:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.831322:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864725.831357:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.831444:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825887488 00000100:00100000:3.0:1787864725.831454:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825887488 00000100:00100000:3.0:1787864725.831533:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888000 00000100:00100000:3.0:1787864725.831536:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888000 00000100:00100000:3.0:1787864725.831554:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888128 00000100:00100000:3.0:1787864725.831557:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888128 00000100:00100000:3.0:1787864725.831570:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:3.0:1787864725.831579:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+7:0:x1874711825887488:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787864725.831619:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864725.831715:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:3.0:1787864725.831719:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+7:0:x1874711825887488:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 142us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.831727:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:2.0:1787864725.831729:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:0:x1874711825888000:12345-192.168.206.36@tcp:41:mount.lustre.0 00000100:00100000:3.0:1787864725.831743:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000004:00000024:2.0:1787864725.831748:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864725.831749:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888128:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787864725.831759:0:8448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787864725.831779:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888128:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864725.831781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:0:x1874711825888000:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.831786:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:2.0:1787864725.831789:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00080000:0.0:1787864725.832375:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864725.832382:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864725.835223:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.835370:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888256 00000100:00100000:3.0:1787864725.835382:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888256 00000100:00100000:3.0:1787864725.835459:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:3.0:1787864725.835471:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888256:12345-192.168.206.36@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787864725.835582:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888256:12345-192.168.206.36@tcp:40:mount.lustre.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.835590:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:1.0:1787864725.842642:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864725.842756:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888384 00000100:00100000:2.0:1787864725.842768:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888384 00000100:00100000:2.0:1787864725.842824:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:2.0:1787864725.842834:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1874711825888384:12345-192.168.206.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787864725.842957:0:8426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from d72d3621-0c17-4b0a-8f7a-94eec1706878@192.168.206.36@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1787864725.842996:0:8426:0:(genops.c:1385:class_connect()) connect: client d72d3621-0c17-4b0a-8f7a-94eec1706878, cookie 0x2fcb8c294dc433b5 00002000:00100000:2.0:1787864725.843010:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d72d3621-0c17-4b0a-8f7a-94eec1706878/ffff927448228800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787864725.843023:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 77 00002000:00080000:2.0:1787864725.843116:0:8426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787864725.843153:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92744822d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864725.843246:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2406:x1874711825888384:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 412us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864725.843255:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:0.0:1787864725.843987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.844114:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888512 00000100:00100000:3.0:1787864725.844121:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888512 00000100:00100000:3.0:1787864725.844162:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:3.0:1787864725.844200:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1874711825888512:12345-192.168.206.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787864725.844230:0:8820:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from d72d3621-0c17-4b0a-8f7a-94eec1706878@192.168.206.36@tcp t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1787864725.844256:0:8820:0:(genops.c:1385:class_connect()) connect: client d72d3621-0c17-4b0a-8f7a-94eec1706878, cookie 0x2fcb8c294dc433bc 00002000:00100000:3.0:1787864725.844267:0:8820:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d72d3621-0c17-4b0a-8f7a-94eec1706878/ffff92744839c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787864725.844284:0:8820:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 77 00002000:00080000:3.0:1787864725.844354:0:8820:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787864725.844378:0:8820:0:(import.c:65:import_set_state_nolock()) ffff92744839b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864725.844430:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2406:x1874711825888512:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 231us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.844437:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:1.0:1787864725.845179:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864725.845506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888640 00000100:00100000:3.0:1787864725.845514:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888640 00000100:00100000:3.0:1787864725.845558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:3.0:1787864725.845567:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888640:12345-192.168.206.36@tcp:900:mount.lustre.0 00000100:00100000:3.0:1787864725.845710:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888640:12345-192.168.206.36@tcp:900:mount.lustre.0 Request processed in 143us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864725.845719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:1.0:1787864725.848606:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864725.848741:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888768 00000100:00100000:2.0:1787864725.848754:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888768 00000100:00100000:2.0:1787864725.848828:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:2.0:1787864725.848840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888768:12345-192.168.206.36@tcp:33:mount.lustre.0 00010000:00010000:0.0:1787864725.849316:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1787864725.849495:0:6513:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787864725.849615:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:8745:x1874711825888768:12345-192.168.206.36@tcp:33:mount.lustre.0 Request processed in 775us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864725.849644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:3.0:1787864726.297881:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844832640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864726.298181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864726.300624:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832640 00000100:00100000:2.0:1787864726.300640:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832640 00000100:00100000:2.0:1787864726.300919:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787864726.300933:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844832640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864726.300984:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864726.301218:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844832640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 288us (3037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864726.301227:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787864726.301593:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844832640:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864726.873103:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864727.898038:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864728.857121:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844832768:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857197:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844833024:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857250:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844833280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857262:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844833536:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857271:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857285:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844833792:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857296:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844834048:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857322:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844834304:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857326:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787864728.857331:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844832896:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857354:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787864728.857359:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844833152:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857360:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844833408:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833024 00000100:00100000:1.0:1787864728.857402:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844833664:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857405:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833024 00000100:00100000:1.0:1787864728.857421:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857433:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844834176:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857441:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833280 00000100:00100000:0.0:1787864728.857444:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833280 00000100:00100000:0.0:1787864728.857460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787864728.857461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857468:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844833024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857500:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833792 00000100:00100000:1.0:1787864728.857504:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833792 00000100:00100000:0.0:1787864728.857515:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844833024:12345-0@lo:400:kworker.0 Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864728.857530:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787864728.857533:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834304 00000100:00100000:1.0:1787864728.857535:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834304 00000100:00100000:0.0:1787864728.857545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787864728.857546:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833664 00000100:00100000:1.0:1787864728.857548:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833664 00000100:00100000:0.0:1787864728.857550:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844833280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857557:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834176 00000100:00100000:1.0:1787864728.857559:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834176 00000100:00100000:1.0:1787864728.857571:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864728.857577:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844833792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857581:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844833280:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864728.857587:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787864728.857604:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844833792:12345-0@lo:400:kworker.0 Request processed in 27us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864728.857609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.857610:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864728.857623:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844833920:0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864728.857681:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844833024:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.857696:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864728.857702:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844834304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857716:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864728.857722:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844833664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857752:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844833664:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864728.857759:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864728.857770:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864728.857776:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844834176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864728.857809:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844834176:12345-0@lo:400:kworker.0 Request processed in 34us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864728.857815:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864728.857832:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833536 00000100:00100000:0.0:1787864728.857836:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833536 00000100:00100000:2.0:1787864728.858133:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834048 00000100:00100000:2.0:1787864728.858137:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834048 00000100:00100000:2.0:1787864728.858168:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832896 00000100:00100000:2.0:1787864728.858171:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832896 00000100:00100000:2.0:1787864728.858181:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833152 00000100:00100000:2.0:1787864728.858183:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833152 00000100:00100000:2.0:1787864728.858193:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833408 00000100:00100000:2.0:1787864728.858195:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833408 00000100:00100000:2.0:1787864728.858205:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844833920 00000100:00100000:2.0:1787864728.858208:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844833920 00000100:00100000:1.0:1787864728.858209:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844834304:12345-0@lo:400:kworker.0 Request processed in 507us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.858216:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864728.858220:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787864728.858225:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844833536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787864728.858231:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864728.858234:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864728.858237:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864728.858239:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864728.858258:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1e580 x1874711844833664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864728.858263:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844833536:12345-0@lo:400:kworker.0 Request processed in 38us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864728.858269:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787864728.858280:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787864728.858281:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844833664:0@lo:400:kworker.0 00000100:00100000:2.0:1787864728.858285:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844834048:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787864728.858293:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1da40 x1874711844834176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.858302:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844834176:0@lo:400:kworker.0 00000100:00100000:2.0:1787864728.858307:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844834048:12345-0@lo:400:kworker.0 Request processed in 23us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.858311:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844833280:0@lo:400:kworker.0 00000100:00100000:2.0:1787864728.858318:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:1.0:1787864728.858319:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1e1c0 x1874711844833792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.858327:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844833792:0@lo:400:kworker.0 00000100:00100000:2.0:1787864728.858329:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787864728.858334:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844832896:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787864728.858335:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1d2c0 x1874711844834304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.858343:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844834304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864728.858358:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844832896:12345-0@lo:400:kworker.0 Request processed in 24us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864728.858363:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787864728.858374:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787864728.858379:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844833152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864728.858482:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844832768 00000100:00100000:3.0:1787864728.858487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844832768 00000100:00100000:3.0:1787864728.858512:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787864728.858518:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844832768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864728.858562:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844832768:12345-0@lo:400:kworker.0 Request processed in 44us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864728.858568:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787864728.858642:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844833152:12345-0@lo:400:kworker.0 Request processed in 263us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.859140:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787864728.859161:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844833408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859198:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844833408:12345-0@lo:400:kworker.0 Request processed in 50us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.859205:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787864728.859219:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787864728.859225:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844833920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859251:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844833920:12345-0@lo:400:kworker.0 Request processed in 26us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.859257:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787864728.859322:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844833152:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859331:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844832768:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859366:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844834560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864728.859394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.859422:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844832896:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859432:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844833408:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859440:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844833920:0@lo:400:kworker.0 00010000:00080000:1.0:1787864728.859451:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdf480 x1874711844833536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.859459:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844833536:0@lo:400:kworker.0 00010000:00080000:1.0:1787864728.859469:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1f0c0 x1874711844834048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.859476:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844834048:0@lo:400:kworker.0 00000100:00100000:1.0:1787864728.859493:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864728.859500:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844834432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864728.859523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864728.859553:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834560 00000100:00100000:1.0:1787864728.859557:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834560 00000100:00100000:1.0:1787864728.859583:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834432 00000100:00100000:1.0:1787864728.859586:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834432 00000100:00100000:1.0:1787864728.859599:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787864728.859605:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844834560:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864728.860788:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864728.860803:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fada940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844834432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864728.860826:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1787864728.860847:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864728.860882:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fada940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844834432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864728.860906:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864728.860909:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844834560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1304us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864728.860914:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1787864728.860947:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558ab9a40 x1874711844834432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.860963:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844834432:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787864728.860975:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad8b40 x1874711844834560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864728.860986:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844834560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864728.863407:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00010000:3.0:1787864728.921232:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864729.882095:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844834688:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864729.882177:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864729.882493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834688 00000100:00100000:0.0:1787864729.882508:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834688 00000100:00100000:0.0:1787864729.882684:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787864729.882755:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844834688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864729.882803:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864729.882920:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844834688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 219us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864729.882928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787864729.885373:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844834688:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864729.947060:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864730.240349:0:12178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1787864730.393083:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864730.393105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844834816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864730.393182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864730.393374:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834816 00000100:00100000:2.0:1787864730.393381:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834816 00000100:00100000:2.0:1787864730.393443:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787864730.393453:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844834816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864730.393480:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864730.393525:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844834816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864730.393532:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787864730.393572:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc6940 x1874711844834816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864730.393590:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844834816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787864730.393639:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864730.394927:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844834944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864730.394984:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864730.395361:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844834944 00000100:00100000:1.0:1787864730.395367:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844834944 00000100:00100000:1.0:1787864730.395421:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787864730.395429:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844834944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864730.395448:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864730.395494:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844834944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864730.395501:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787864730.395536:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad8b40 x1874711844834944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864730.395552:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844834944:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787864730.395647:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787864730.974350:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864731.232557:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.233013:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864731.237689:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889024 00000100:00100000:1.0:1787864731.237702:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889024 00000100:00100000:2.0:1787864731.238816:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889280 00000100:00100000:2.0:1787864731.238824:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889280 00000100:00100000:2.0:1787864731.238881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:2.0:1787864731.238908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825889024:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864731.239071:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825889024:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 103us (6444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864731.239081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:2.0:1787864731.239103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00100000:2.0:1787864731.239111:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889280:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864731.239152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889280:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (6127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864731.239158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00080000:0.0:1787864731.239785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864731.241231:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.241332:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.241357:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825888896 00000100:00100000:3.0:1787864731.241364:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825888896 00000100:00100000:3.0:1787864731.241411:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 303 00000100:00100000:3.0:1787864731.241420:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825888896:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864731.241474:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825888896:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 56us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864731.241488:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 303 00000100:00100000:3.0:1787864731.241539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.241828:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.241871:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864731.241912:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889152 00000100:00100000:3.0:1787864731.241917:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889152 00000100:00100000:3.0:1787864731.241949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889408 00000100:00100000:3.0:1787864731.241952:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889408 00000100:00100000:3.0:1787864731.242030:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:3.0:1787864731.242038:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825889152:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864731.242076:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825889152:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864731.242082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:3.0:1787864731.242095:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:3.0:1787864731.242101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889408:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864731.242122:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889408:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 22us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864731.242128:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:3.0:1787864731.242157:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889536 00000100:00100000:3.0:1787864731.242161:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889536 00000100:00100000:3.0:1787864731.242185:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889664 00000100:00100000:3.0:1787864731.242187:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889664 00000100:00100000:3.0:1787864731.242204:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:3.0:1787864731.242210:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889536:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864731.242234:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889536:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864731.242246:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:3.0:1787864731.242515:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:3.0:1787864731.242523:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889664:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864731.242548:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2407:x1874711825889664:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864731.242554:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00080000:3.0:1787864731.242575:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864731.242579:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864731.242581:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864731.417373:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864731.417394:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844835072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864731.417457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864731.417512:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835072 00000100:00100000:0.0:1787864731.417519:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835072 00000100:00100000:0.0:1787864731.417559:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787864731.417568:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844835072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864731.417598:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787864731.417640:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844835072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864731.417659:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787864731.417702:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844835072:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1787864731.935087:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00100000:3.0:1787864731.935117:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00100000:2.0:1787864731.935211:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00100000:3.0:1787864731.935265:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00010000:00010000:2.0:1787864731.998344:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864733.016993:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864733.977187:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844835200:0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.977256:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864733.977371:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835200 00000100:00100000:0.0:1787864733.977378:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835200 00000100:00100000:0.0:1787864733.977423:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787864733.977433:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844835200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.977959:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844835712:0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.977991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864733.978058:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844835200:12345-0@lo:400:kworker.0 Request processed in 626us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864733.978066:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787864733.978972:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844835328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864733.979037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864733.979086:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844835584:0@lo:400:kworker.0 00000100:00100000:0.0:1787864733.979112:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864733.979141:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864733.979148:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448865a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844835456:0@lo:400:kworker.0 00000100:00100000:0.0:1787864733.979171:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864733.979231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835584 00000100:00100000:0.0:1787864733.979236:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835584 00000100:00100000:0.0:1787864733.979270:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787864733.979278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844835584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864733.979447:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844835584:12345-0@lo:400:kworker.0 Request processed in 169us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864733.979453:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787864733.979473:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835712 00000100:00100000:0.0:1787864733.979476:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835712 00000100:00100000:0.0:1787864733.979498:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835456 00000100:00100000:0.0:1787864733.979501:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835456 00000100:00100000:0.0:1787864733.979517:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787864733.979522:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844835712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864733.979552:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844835712:12345-0@lo:400:kworker.0 Request processed in 30us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864733.979558:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787864733.979569:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864733.979575:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864733.979600:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844835456:12345-0@lo:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864733.979617:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787864733.979782:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864733.979811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864733.979840:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835328 00000100:00100000:1.0:1787864733.979844:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835328 00000100:00100000:1.0:1787864733.979877:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835840 00000100:00100000:1.0:1787864733.979880:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835840 00000100:00100000:1.0:1787864733.979914:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864733.979920:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844835328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864733.979941:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864733.979975:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844835328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864733.979981:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864733.979994:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787864733.980000:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fada580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844835840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864733.980009:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864733.980031:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fada580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844835840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864733.980038:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787864733.980064:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1f840 x1874711844835840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864733.980081:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844835840:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787864733.980093:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadb840 x1874711844835328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864733.980117:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844835328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864733.980169:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448865a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844835456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864733.980178:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844835584:0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.982856:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844835200:0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.982914:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844835712:0@lo:400:kworker.0 00000100:00080000:2.0:1787864733.982956:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864733.984108:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844835968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864733.984181:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864733.984274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844835968 00000100:00100000:2.0:1787864733.984281:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844835968 00000100:00100000:2.0:1787864733.984425:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864733.984433:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844835968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986044:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844836096:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986098:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864733.986158:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836096 00000100:00100000:3.0:1787864733.986164:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836096 00000100:00100000:3.0:1787864733.986207:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787864733.986215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986256:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844836096:12345-0@lo:400:kworker.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864733.986262:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1787864733.986279:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864733.986367:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844836096:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986419:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864733.986425:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986456:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864733.986479:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836480 00000100:00100000:3.0:1787864733.986482:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836480 00000100:00100000:3.0:1787864733.986508:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864733.986514:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844836480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986542:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844836480:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864733.986547:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787864733.986558:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864733.986575:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbbb480 x1874711844836480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864733.986586:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844836480:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844836224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864733.986717:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864733.986723:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844836352:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864733.986767:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836352 00000100:00100000:3.0:1787864733.986770:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836352 00000100:00100000:3.0:1787864733.986798:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787864733.986804:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844836352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986832:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844836352:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864733.986838:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787864733.986852:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864733.986869:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472fc780 x1874711844836352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864733.986885:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844836352:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986935:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844836608:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.986961:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864733.987010:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844836736:0@lo:400:kworker.0 00000100:00100000:3.0:1787864733.987033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864733.987180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844835968:12345-0@lo:400:kworker.0 Request processed in 2746us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864733.987195:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864733.987230:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836224 00000100:00100000:2.0:1787864733.987234:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836224 00000100:00100000:2.0:1787864733.987256:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836608 00000100:00100000:2.0:1787864733.987259:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836608 00000100:00100000:2.0:1787864733.987275:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836736 00000100:00100000:2.0:1787864733.987277:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836736 00000100:00100000:2.0:1787864733.987367:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864733.987375:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.987413:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844836224:12345-0@lo:400:kworker.0 Request processed in 39us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864733.987419:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787864733.987431:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787864733.987437:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844836608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.987462:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844836608:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864733.987467:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787864733.987476:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787864733.987480:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844836736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864733.987499:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844836736:12345-0@lo:400:kworker.0 Request processed in 19us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864733.987504:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1787864733.987785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864733.987788:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864733.987816:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844836608:0@lo:400:kworker.0 00010000:00080000:3.0:1787864733.987842:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c7840 x1874711844836736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864733.987851:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844836736:0@lo:400:kworker.0 00010000:00080000:3.0:1787864733.987861:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472fe940 x1874711844836224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864733.987869:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844836224:0@lo:400:kworker.0 00000100:00100000:1.0:1787864733.988097:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844835968:0@lo:400:kworker.0 00010000:00010000:0.0:1787864734.041056:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864735.001054:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844836864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864735.001135:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864735.001263:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836864 00000100:00100000:1.0:1787864735.001270:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836864 00000100:00100000:1.0:1787864735.001318:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787864735.001327:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844836864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864735.001364:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864735.001460:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844836864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864735.001467:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864735.001639:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844836864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864735.065047:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864735.513070:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844836992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864735.513148:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864735.513245:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844836992 00000100:00100000:1.0:1787864735.513253:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844836992 00000100:00100000:1.0:1787864735.513311:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787864735.513321:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844836992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864735.513347:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864735.513390:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844836992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864735.513397:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787864735.513432:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad9a40 x1874711844836992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864735.513458:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844836992:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787864735.513508:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864735.517365:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864735.517386:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844837120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864735.517453:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864735.517537:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837120 00000100:00100000:1.0:1787864735.517544:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837120 00000100:00100000:1.0:1787864735.517610:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787864735.517619:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844837120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864735.517639:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864735.517683:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844837120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864735.517690:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1787864735.517739:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad9a40 x1874711844837120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787864735.517774:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864735.517991:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844837120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864736.094422:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864736.349550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864736.349667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864736.350307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864736.350348:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864736.350370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864736.350441:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890432 00000100:00100000:0.0:1787864736.350454:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890432 00000100:00100000:0.0:1787864736.350532:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:0.0:1787864736.350544:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890432:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864736.350619:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890432:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 78us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864736.350627:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00080000:0.0:1787864736.350650:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864736.350680:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889792 00000100:00100000:0.0:1787864736.350684:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889792 00000100:00100000:0.0:1787864736.350709:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 305 00000100:00100000:0.0:1787864736.350716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825889792:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864736.350741:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825889792:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864736.350748:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 305 00000100:00100000:2.0:1787864736.350824:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825889920 00000100:00100000:2.0:1787864736.350835:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825889920 00000100:00100000:2.0:1787864736.350943:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890176 00000100:00100000:2.0:1787864736.350948:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890176 00000100:00100000:0.0:1787864736.350972:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 139 00000100:00100000:0.0:1787864736.350985:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825889920:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864736.351002:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:2.0:1787864736.351020:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890176:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864736.351086:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890176:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 72us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864736.351094:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:0.0:1787864736.351173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825889920:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 189us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864736.351182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 139 00000100:00080000:0.0:1787864736.351209:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864736.351667:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864736.351704:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864736.351734:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890048 00000100:00100000:0.0:1787864736.351743:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890048 00000100:00100000:3.0:1787864736.351755:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890560 00000100:00100000:3.0:1787864736.351762:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890560 00000100:00100000:0.0:1787864736.351791:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890304 00000100:00100000:0.0:1787864736.351798:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890304 00000100:00100000:3.0:1787864736.351826:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:3.0:1787864736.351841:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890560:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864736.351851:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 141 00000100:00100000:0.0:1787864736.351863:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825890048:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864736.351934:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890560:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864736.351943:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00080000:3.0:1787864736.352003:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864736.352008:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864736.352020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 142 00000100:00100000:3.0:1787864736.352028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890304:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864736.352066:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825890304:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864736.352073:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 142 00000100:00100000:0.0:1787864736.352993:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825890048:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 1124us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864736.353004:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 141 00000100:00100000:2.0:1787864736.537068:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864736.537091:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864736.537168:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864736.537272:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837248 00000100:00100000:0.0:1787864736.537288:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837248 00000100:00100000:0.0:1787864736.537342:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787864736.537351:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864736.537381:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787864736.537426:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864736.537434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787864736.537472:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837248:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1787864737.081854:0:12494:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864737.082152:0:12494:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864737.113266:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864738.142023:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787864738.856803:0:12591:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787864738.857294:0:12591:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787864739.097395:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864739.097464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.097576:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837376 00000100:00100000:0.0:1787864739.097594:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837376 00000100:00100000:0.0:1787864739.097647:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787864739.097657:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864739.097685:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864739.097733:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.097740:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1787864739.097776:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad8f00 x1874711844837376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864739.097794:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837376:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787864739.097855:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864739.097914:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844837504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864739.097942:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864739.097995:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837504 00000100:00100000:1.0:1787864739.097999:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837504 00000100:00100000:1.0:1787864739.098035:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787864739.098042:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844837504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864739.098053:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864739.098081:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844837504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864739.098088:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1787864739.098120:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757db1e1c0 x1874711844837504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864739.098140:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844837504:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787864739.098230:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864739.098431:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837888:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098477:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098495:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844838400:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098543:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844838912:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098574:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787864739.098578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844837760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098593:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098606:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844838272:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098624:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098640:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844838784:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098660:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864739.098690:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837888 00000100:00100000:0.0:1787864739.098694:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837888 00000100:00100000:0.0:1787864739.098730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787864739.098736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098774:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844837888:12345-0@lo:400:kworker.0 Request processed in 38us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.098780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787864739.098798:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838400 00000100:00100000:0.0:1787864739.098801:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838400 00000100:00100000:0.0:1787864739.098825:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838912 00000100:00100000:0.0:1787864739.098827:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838912 00000100:00100000:0.0:1787864739.098838:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837760 00000100:00100000:0.0:1787864739.098841:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837760 00000100:00100000:0.0:1787864739.098849:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838272 00000100:00100000:0.0:1787864739.098851:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838272 00000100:00100000:0.0:1787864739.098859:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838784 00000100:00100000:0.0:1787864739.098861:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838784 00000100:00100000:0.0:1787864739.098871:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787864739.098876:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844838400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098923:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844838400:12345-0@lo:400:kworker.0 Request processed in 47us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.098929:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787864739.098939:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787864739.098944:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844838912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.098967:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844838912:12345-0@lo:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.098977:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787864739.098988:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787864739.098993:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844837760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099018:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844837760:12345-0@lo:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.099031:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787864739.099043:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787864739.099049:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844838272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099077:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844838272:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.099082:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787864739.099092:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787864739.099110:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844838784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099134:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fade940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844838784:12345-0@lo:400:kworker.0 Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.099140:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787864739.099162:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864739.099165:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864739.099183:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844837760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099192:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844838272:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099199:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844838784:0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.099206:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844837888:0@lo:400:kworker.0 00010000:00080000:0.0:1787864739.099215:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdc3c0 x1874711844838400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864739.099223:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844838400:0@lo:400:kworker.0 00010000:00080000:0.0:1787864739.099231:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbde940 x1874711844838912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864739.099238:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844838912:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099365:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844837632:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864739.099431:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844838144:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864739.099479:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844838656:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864739.099524:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787864739.099530:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844838016:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099553:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864739.099569:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844838528:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864739.099624:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838016 00000100:00100000:3.0:1787864739.099628:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838016 00000100:00100000:3.0:1787864739.099668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787864739.099675:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844838016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844838016:12345-0@lo:400:kworker.0 Request processed in 36us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864739.099717:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787864739.099735:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838656 00000100:00100000:3.0:1787864739.099738:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838656 00000100:00100000:3.0:1787864739.099763:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838528 00000100:00100000:3.0:1787864739.099766:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838528 00000100:00100000:3.0:1787864739.099782:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864739.099787:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844838656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099816:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844838656:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864739.099822:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864739.099832:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864739.099838:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844838528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.099865:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844838528:12345-0@lo:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864739.099871:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1787864739.099920:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864739.099939:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844838016:0@lo:400:kworker.0 00010000:00080000:3.0:1787864739.099948:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbde1c0 x1874711844838528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864739.099956:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844838528:0@lo:400:kworker.0 00010000:00080000:3.0:1787864739.099977:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbde580 x1874711844838656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864739.099985:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844838656:0@lo:400:kworker.0 00000100:00100000:2.0:1787864739.100053:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844838144 00000100:00100000:2.0:1787864739.100057:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844838144 00000100:00100000:2.0:1787864739.100089:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864739.100103:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566fb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844838144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864739.100137:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566fb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844838144:12345-0@lo:400:kworker.0 Request processed in 43us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864739.100143:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787864739.100671:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844837632 00000100:00100000:0.0:1787864739.100676:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844837632 00000100:00100000:0.0:1787864739.100713:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787864739.100720:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844837632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864739.100756:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844837632:12345-0@lo:400:kworker.0 Request processed in 37us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864739.100762:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787864739.100878:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844837632:0@lo:400:kworker.0 00000100:00100000:3.0:1787864739.100910:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844838144:0@lo:400:kworker.0 00010000:00010000:0.0:1787864739.163036:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864740.123716:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844839040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864740.123784:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864740.123913:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839040 00000100:00100000:1.0:1787864740.123921:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839040 00000100:00100000:1.0:1787864740.123966:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787864740.123976:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844839040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864740.124005:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864740.124055:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844839040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864740.124074:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787864740.124323:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844839040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864740.187943:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787864740.590022:0:12688:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864740.590284:0:12688:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787864740.633778:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844839168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864740.633928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864740.634098:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864740.634108:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844839296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864740.634146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864740.634924:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839168 00000100:00100000:1.0:1787864740.634932:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839168 00000100:00100000:1.0:1787864740.634981:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839296 00000100:00100000:1.0:1787864740.634985:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839296 00000100:00100000:1.0:1787864740.635000:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864740.635008:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844839168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864740.635036:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864740.635101:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844839168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864740.635108:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864740.635124:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787864740.635130:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844839296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864740.635140:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864740.635168:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844839296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864740.635174:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787864740.635295:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbc5a40 x1874711844839296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864740.635313:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844839296:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787864740.635345:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dcccb40 x1874711844839168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864740.635357:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844839168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787864741.209059:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864741.472250:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864741.472363:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864741.472388:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890688 00000100:00100000:3.0:1787864741.472404:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864741.472406:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890688 00000100:00100000:3.0:1787864741.472451:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864741.472479:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864741.472494:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 307 00000100:00100000:1.0:1787864741.472508:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825890688:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864741.472617:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825890688:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 111us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864741.472626:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 307 00000100:00100000:2.0:1787864741.473193:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890944 00000100:00100000:2.0:1787864741.473201:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890944 00000100:00100000:2.0:1787864741.473269:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891200 00000100:00100000:2.0:1787864741.473273:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891200 00000100:00100000:3.0:1787864741.473298:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825890816 00000100:00100000:2.0:1787864741.473306:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 149 00000100:00100000:3.0:1787864741.473311:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825890816 00000100:00100000:2.0:1787864741.473320:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825890944:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864741.473375:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 150 00000100:00100000:2.0:1787864741.473383:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825890944:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 65us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864741.473393:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891200:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864741.473402:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 149 00000100:00100000:2.0:1787864741.473425:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 151 00000100:00100000:2.0:1787864741.473435:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825890816:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864741.473488:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825890816:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 47us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864741.473489:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558999a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891200:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 93us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864741.473499:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 151 00000100:00080000:1.0:1787864741.473582:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864741.473587:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864741.474449:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 150 00000100:00100000:3.0:1787864741.474488:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891456 00000100:00100000:3.0:1787864741.475258:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891456 00000100:00100000:3.0:1787864741.475329:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:3.0:1787864741.475338:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891456:12345-192.168.206.36@tcp:400:kworker.0 00000100:00080000:1.0:1787864741.475382:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864741.475401:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891456:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 62us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864741.475412:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:3.0:1787864741.475906:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864741.475954:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891072 00000100:00100000:2.0:1787864741.475965:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891072 00000100:00100000:3.0:1787864741.475990:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864741.476046:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 152 00000100:00100000:2.0:1787864741.476057:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891072:12345-192.168.206.36@tcp:400:kworker.0 00000100:00080000:1.0:1787864741.476714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864741.477763:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558998b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891072:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 1696us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864741.477778:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 152 00000100:00100000:3.0:1787864741.482358:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891328 00000100:00100000:3.0:1787864741.482374:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891328 00000100:00080000:1.0:1787864741.482449:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864741.483071:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:3.0:1787864741.483095:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891328:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864741.483403:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825891328:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 321us (7415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864741.483414:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:1.0:1787864741.658337:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844839424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864741.658408:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864741.659203:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839424 00000100:00100000:0.0:1787864741.659211:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839424 00000100:00100000:0.0:1787864741.659266:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787864741.659276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844839424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864741.659310:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787864741.659364:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844839424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864741.659371:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864741.659467:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844839424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864742.237725:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787864742.362418:0:12785:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864742.362661:0:12785:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787864743.257208:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787864743.993289:0:12882:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864743.993509:0:12882:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787864744.217112:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864744.217259:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844839552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864744.217326:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.217404:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844839680:0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.217444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864744.217531:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844839808:0@lo:400:kworker.0 00000100:00100000:1.0:1787864744.217536:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839680 00000100:00100000:1.0:1787864744.217543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839680 00000100:00100000:2.0:1787864744.217571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864744.217592:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787864744.217602:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844839680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864744.217646:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839552 00000100:00100000:3.0:1787864744.217652:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839552 00000100:00100000:1.0:1787864744.217663:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844839680:12345-0@lo:400:kworker.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.217683:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1787864744.217695:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787864744.217705:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844839552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864744.217728:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864744.217768:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844839552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864744.217774:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787864744.217799:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864744.217823:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844839936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864744.217851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864744.217964:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839936 00000100:00100000:1.0:1787864744.217969:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839936 00000100:00100000:1.0:1787864744.217998:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864744.218005:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844839936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864744.218015:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864744.218042:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844839936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.218048:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787864744.218063:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864744.220278:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844840320:0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844839680:0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220302:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844840192:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220353:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220355:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864744.220396:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844840832:0@lo:400:kworker.0 00010000:00080000:0.0:1787864744.220409:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fade1c0 x1874711844839552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864744.220425:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220432:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844839552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864744.220460:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844840704:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220475:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844839808 00000100:00100000:2.0:1787864744.220482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844839808 00000100:00100000:0.0:1787864744.220487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220510:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844841216:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840192 00000100:00100000:2.0:1787864744.220536:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840192 00000100:00100000:0.0:1787864744.220536:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220564:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787864744.220565:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787864744.220575:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844840064:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220576:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844839808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220631:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844840576:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844839808:12345-0@lo:400:kworker.0 Request processed in 62us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864744.220645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787864744.220659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864744.220663:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787864744.220672:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844840192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220684:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844841088:0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.220738:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844840192:0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220758:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840576 00000100:00100000:0.0:1787864744.220762:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840576 00000100:00100000:0.0:1787864744.220788:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841088 00000100:00100000:0.0:1787864744.220791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841088 00000100:00100000:0.0:1787864744.220805:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787864744.220811:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.220848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844840576:12345-0@lo:400:kworker.0 Request processed in 36us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864744.220855:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787864744.220867:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787864744.220873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844840192:12345-0@lo:400:kworker.0 Request processed in 36us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864744.220882:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844841088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.220885:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787864744.220931:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840832 00000100:00100000:2.0:1787864744.220935:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840832 00000100:00100000:2.0:1787864744.220965:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840704 00000100:00100000:2.0:1787864744.220968:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840704 00000100:00100000:2.0:1787864744.220981:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841216 00000100:00100000:2.0:1787864744.220983:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841216 00000100:00100000:2.0:1787864744.220994:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787864744.221007:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864744.221039:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840320 00000100:00100000:2.0:1787864744.221043:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844840832:12345-0@lo:400:kworker.0 Request processed in 36us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.221046:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840320 00000100:00100000:2.0:1787864744.221054:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787864744.221090:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840064 00000100:00100000:1.0:1787864744.221094:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840064 00000100:00100000:1.0:1787864744.221107:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787864744.221113:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844840320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.221142:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864744.221152:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844840704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864744.221163:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844840320:12345-0@lo:400:kworker.0 Request processed in 49us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.221171:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787864744.221188:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864744.221193:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844840704:12345-0@lo:400:kworker.0 Request processed in 42us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.221199:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844840064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.221205:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864744.221221:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787864744.221230:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864744.221239:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844840064:12345-0@lo:400:kworker.0 Request processed in 43us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864744.221246:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864744.221267:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844841216:12345-0@lo:400:kworker.0 Request processed in 38us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864744.221273:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787864744.221308:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844839808:0@lo:400:kworker.0 00000100:00100000:2.0:1787864744.221418:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844840320:0@lo:400:kworker.0 00010000:00080000:2.0:1787864744.221428:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558995e00 x1874711844840832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864744.221436:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844840832:0@lo:400:kworker.0 00000100:00080000:2.0:1787864744.221579:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864744.221583:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864744.222879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844840064:0@lo:400:kworker.0 00010000:00080000:1.0:1787864744.222928:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558997c00 x1874711844840576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864744.223035:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844840576:0@lo:400:kworker.0 00010000:00080000:1.0:1787864744.223053:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558994b40 x1874711844841088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864744.223062:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844841088:0@lo:400:kworker.0 00010000:00080000:1.0:1787864744.223085:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558995a40 x1874711844840704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864744.223093:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844840704:0@lo:400:kworker.0 00010000:00080000:1.0:1787864744.223103:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558997840 x1874711844841216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864744.223112:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844841216:0@lo:400:kworker.0 00010000:00080000:3.0:1787864744.223469:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadb840 x1874711844839936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864744.223484:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844839936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864744.223494:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844840448:0@lo:400:kworker.0 00000100:00100000:3.0:1787864744.223540:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864744.223575:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844840960:0@lo:400:kworker.0 00000100:00100000:3.0:1787864744.223598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864744.223684:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844841088:12345-0@lo:400:kworker.0 Request processed in 58us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864744.223694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787864744.223715:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840448 00000100:00100000:0.0:1787864744.223719:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840448 00000100:00100000:0.0:1787864744.227371:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844840960 00000100:00100000:0.0:1787864744.227382:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844840960 00000100:00100000:0.0:1787864744.227417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787864744.227427:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844840448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.227512:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844840448:12345-0@lo:400:kworker.0 Request processed in 87us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864744.227519:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787864744.227535:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787864744.227541:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844840960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864744.227571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844840960:12345-0@lo:400:kworker.0 Request processed in 30us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864744.227577:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787864744.227878:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864744.228257:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844840448:0@lo:400:kworker.0 00000100:00100000:3.0:1787864744.228276:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844840960:0@lo:400:kworker.0 00010000:00010000:0.0:1787864744.282235:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864745.241265:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864745.241288:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844841344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864745.241352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864745.241567:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841344 00000100:00100000:1.0:1787864745.241583:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841344 00000100:00100000:1.0:1787864745.241642:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787864745.241651:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844841344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864745.241683:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864745.241795:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844841344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864745.241803:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787864745.241950:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844841344:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864745.305005:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864745.755867:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864745.755912:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92755883f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844841472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864745.755995:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864745.756096:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841472 00000100:00100000:2.0:1787864745.756113:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841472 00000100:00100000:2.0:1787864745.756162:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787864745.756171:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757e2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844841472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864745.756206:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864745.756250:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757e2b3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844841472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864745.756257:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787864745.756431:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844841600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864745.756457:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864745.756505:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841600 00000100:00100000:3.0:1787864745.756510:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841600 00000100:00100000:3.0:1787864745.756542:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787864745.756549:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844841600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864745.756560:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1787864745.756594:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92755883f480 x1874711844841472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864745.756602:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844841600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864745.756611:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787864745.756619:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92755883f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844841472:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787864745.756773:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcc61c0 x1874711844841600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864745.756787:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844841600:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787864746.329639:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864746.592032:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864746.592089:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864746.592111:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864746.592157:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864746.592173:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891584 00000100:00100000:1.0:1787864746.592189:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891584 00000100:00100000:1.0:1787864746.592269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 309 00000100:00100000:1.0:1787864746.592279:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825891584:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864746.592355:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891712 00000100:00100000:0.0:1787864746.592365:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891712 00000100:00100000:1.0:1787864746.592371:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825891584:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864746.592383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 309 00000100:00100000:0.0:1787864746.592444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891840 00000100:00100000:0.0:1787864746.592449:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891840 00000100:00100000:0.0:1787864746.592470:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825891968 00000100:00100000:0.0:1787864746.592472:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825891968 00000100:00100000:0.0:1787864746.592496:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:0.0:1787864746.592525:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825891712:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864746.592559:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:1.0:1787864746.592572:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825891840:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864746.592606:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825891712:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 82us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864746.592615:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:1.0:1787864746.592631:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825891840:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864746.592642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 161 00000100:00100000:0.0:1787864746.592652:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825891968:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864746.592689:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825891968:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00080000:2.0:1787864746.593557:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864746.593565:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864746.593675:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:1.0:1787864746.593947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864746.594982:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864746.595028:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864746.595072:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892224 00000100:00100000:1.0:1787864746.595083:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892224 00000100:00100000:1.0:1787864746.595149:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892352 00000100:00100000:1.0:1787864746.595154:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892352 00000100:00100000:1.0:1787864746.595178:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:1.0:1787864746.595201:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2406:x1874711825892224:12345-192.168.206.36@tcp:9:kworker.0 00000020:00000080:1.0:1787864746.595269:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc433b5 00000100:00080000:1.0:1787864746.595279:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92744822d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787864746.595333:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787864746.595522:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+2:2406:x1874711825892224:12345-192.168.206.36@tcp:9:kworker.0 Request processed in 323us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864746.595531:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:1.0:1787864746.595546:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864746.595553:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2406:x1874711825892352:12345-192.168.206.36@tcp:9:kworker.0 00000020:00000080:1.0:1787864746.595565:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc433bc 00000100:00080000:1.0:1787864746.595584:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92744839b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787864746.595609:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1787864746.595693:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+2:2406:x1874711825892352:12345-192.168.206.36@tcp:9:kworker.0 Request processed in 139us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864746.595704:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:0.0:1787864746.595712:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 161 00010000:00010000:1.0:1787864746.595735:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864746.595743:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892096 00000100:00080000:1.0:1787864746.595745:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864746.595750:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892096 00000100:00080000:1.0:1787864746.595752:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864746.596540:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 162 00000100:00100000:0.0:1787864746.596566:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825892096:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864746.596626:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825892096:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 66us (2681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864746.596741:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 162 00010000:00010000:0.0:1787864746.596773:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864746.596801:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864746.777254:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92755883c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864746.777367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864746.777571:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841728 00000100:00100000:2.0:1787864746.777581:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841728 00000100:00100000:2.0:1787864746.777884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864746.778451:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fada1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844841728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864746.778501:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864746.778601:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fada1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844841728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864746.779205:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92755883c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864746.779872:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000001:02000400:0.0:1787864747.071124:0:13027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787864747.353043:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864748.378097:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864749.337320:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864749.337345:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844841856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864749.337415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864749.337756:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864749.337767:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844841984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864749.337799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864749.338505:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841856 00000100:00100000:2.0:1787864749.338515:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841856 00000100:00100000:2.0:1787864749.338572:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844841984 00000100:00100000:2.0:1787864749.338576:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844841984 00000100:00100000:2.0:1787864749.338606:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787864749.338615:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844841856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864749.338658:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864749.338710:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844841856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864749.338717:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787864749.338731:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787864749.338738:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757faded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844841984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787864749.338748:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864749.338779:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757faded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844841984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864749.338784:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787864749.338821:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadd680 x1874711844841984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864749.338839:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844841984:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787864749.339005:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787864749.339248:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadf840 x1874711844841856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864749.339264:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844841856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864749.340871:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844842112:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.340946:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864749.341090:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842112 00000100:00100000:0.0:1787864749.341097:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842112 00000100:00100000:0.0:1787864749.341149:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787864749.341169:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844842112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.341362:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844842240:0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.341396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864749.341432:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842240 00000100:00100000:2.0:1787864749.341436:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842240 00000100:00100000:2.0:1787864749.341466:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787864749.341473:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844842240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.341508:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844842240:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864749.341515:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787864749.341550:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844842240:0@lo:400:kworker.0 00000100:00100000:0.0:1787864749.345828:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844842112:12345-0@lo:400:kworker.0 Request processed in 4653us (4873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864749.345844:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787864749.345979:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844842112:0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.347749:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844842368:0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.347829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.347988:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844842496:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.348021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.348095:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842496 00000100:00100000:3.0:1787864749.348101:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842496 00000100:00100000:3.0:1787864749.348141:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787864749.348149:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844842496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.348199:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844842496:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864749.348205:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787864749.348265:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844842496:0@lo:400:kworker.0 00000100:00100000:0.0:1787864749.348451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842368 00000100:00100000:0.0:1787864749.348456:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842368 00000100:00100000:0.0:1787864749.348493:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787864749.348501:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844842368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349289:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844843008:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349329:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349367:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787864749.349374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844842880:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349427:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844843392:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349477:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842880 00000100:00100000:3.0:1787864749.349482:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842880 00000100:00100000:3.0:1787864749.349519:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843392 00000100:00100000:3.0:1787864749.349522:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843392 00000100:00100000:3.0:1787864749.349557:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787864749.349565:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844842880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349603:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844842880:12345-0@lo:400:kworker.0 Request processed in 39us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864749.349609:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787864749.349623:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787864749.349629:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844843392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349655:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844843392:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864749.349661:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787864749.349681:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844842624:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349704:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349719:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844843136:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349736:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349751:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787864749.349757:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844842752:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349778:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349794:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844843264:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864749.349834:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842752 00000100:00100000:3.0:1787864749.349844:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842752 00000100:00100000:3.0:1787864749.349863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843264 00000100:00100000:3.0:1787864749.349866:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843264 00000100:00100000:3.0:1787864749.349879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787864749.349884:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844842752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.349939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844842752:12345-0@lo:400:kworker.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864749.349945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787864749.349956:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787864749.349962:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844843264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.350381:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844843264:12345-0@lo:400:kworker.0 Request processed in 417us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864749.350388:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:3.0:1787864749.350429:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada940 x1874711844842880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864749.350441:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844842880:0@lo:400:kworker.0 00010000:00080000:3.0:1787864749.350452:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad8f00 x1874711844843392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864749.350460:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844843392:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.350490:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844842752:0@lo:400:kworker.0 00000100:00100000:3.0:1787864749.350499:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844843264:0@lo:400:kworker.0 00000100:00100000:1.0:1787864749.350676:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843008 00000100:00100000:1.0:1787864749.350682:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843008 00000100:00100000:1.0:1787864749.350713:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843136 00000100:00100000:1.0:1787864749.350716:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843136 00000100:00100000:1.0:1787864749.350739:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787864749.350746:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844843008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864749.350789:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844843008:12345-0@lo:400:kworker.0 Request processed in 44us (1460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864749.350804:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787864749.350816:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864749.350822:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844843136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864749.350855:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844843136:12345-0@lo:400:kworker.0 Request processed in 34us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864749.350861:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864749.350878:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844842624 00000100:00100000:1.0:1787864749.350881:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844842624 00000100:00100000:1.0:1787864749.350920:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787864749.350926:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844842624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864749.350956:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844842624:12345-0@lo:400:kworker.0 Request processed in 30us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864749.350962:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1787864749.351062:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad83c0 x1874711844843008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864749.351072:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844843008:0@lo:400:kworker.0 00000100:00080000:1.0:1787864749.351103:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864749.351108:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864749.351110:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864749.351196:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844842368:12345-0@lo:400:kworker.0 Request processed in 2695us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864749.351203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787864749.351429:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844842624:0@lo:400:kworker.0 00010000:00080000:3.0:1787864749.351440:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada580 x1874711844843136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864749.351463:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844843136:0@lo:400:kworker.0 00000100:00100000:2.0:1787864749.351533:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844842368:0@lo:400:kworker.0 00010000:00010000:1.0:1787864749.401021:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787864750.051120:0:13174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8a70e650 20000000:00000080:1.0:1787864750.051135:0:13174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff927447e4f000 uarg=0000000000000000 20000000:01000000:1.0:1787864750.051176:0:13174:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787864750.051183:0:13174:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787864750.051188:0:13174:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787864750.052644:0:13175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787864750.052790:0:13174:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787864750.057809:0:13174:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787864750.057989:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058008:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058016:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058022:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058028:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058047:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058055:0:13174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058062:0:13174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058101:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058130:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058144:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843520:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864750.058398:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058407:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 12 pid: 6503 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058415:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843648:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864750.058446:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058454:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 23 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058461:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843776:0@lo:104: 00000100:00100000:2.0:1787864750.058495:0:13174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864750.058535:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058543:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 23 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058551:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843904:0@lo:104: 00000100:00100000:2.0:1787864750.058575:0:13174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864750.058619:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058628:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 23 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058635:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844844032:0@lo:104: 00000100:00100000:2.0:1787864750.058655:0:13174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864750.058673:0:13174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.058680:0:13174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.058687:0:13174:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844844160:0@lo:104: 00000100:00100000:2.0:1787864750.058706:0:13174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864750.058715:0:13174:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548aea240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864750.058772:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843776 00000100:00100000:3.0:1787864750.058778:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843776 00000100:00100000:3.0:1787864750.058810:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844843904 00000100:00100000:3.0:1787864750.058812:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844843904 00000100:00100000:3.0:1787864750.058819:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844032 00000100:00100000:3.0:1787864750.058821:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844032 00000100:00100000:3.0:1787864750.058828:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844160 00000100:00100000:3.0:1787864750.058829:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844160 00000100:00100000:3.0:1787864750.058854:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864750.058862:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:13174:x1874711844843776:12345-0@lo:104: 00010000:00010000:3.0:1787864750.058874:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.058958:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787864750.058963:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:13174:x1874711844843776:12345-0@lo:104: Request processed in 103us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.058969:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864750.058984:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864750.058989:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:13174:x1874711844843904:12345-0@lo:104: 00010000:00010000:3.0:1787864750.058995:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.059023:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787864750.059028:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:13174:x1874711844843904:12345-0@lo:104: Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.059033:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864750.059063:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787864750.059068:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:13174:x1874711844844032:12345-0@lo:104: 00010000:00010000:3.0:1787864750.059074:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.059105:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787864750.059109:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:13174:x1874711844844032:12345-0@lo:104: Request processed in 42us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.059115:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787864750.059128:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864750.059133:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:13174:x1874711844844160:12345-0@lo:104: 00010000:00010000:3.0:1787864750.059139:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.059172:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787864750.059176:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:13174:x1874711844844160:12345-0@lo:104: Request processed in 44us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.059181:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1787864750.059204:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787864750.059212:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864750.059220:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864750.059224:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864750.059233:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864750.059239:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864750.059245:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787864750.059305:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843776:0@lo:104: 00000100:00100000:2.0:1787864750.059313:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843904:0@lo:104: 00000100:00100000:2.0:1787864750.059319:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844844032:0@lo:104: 00000100:00100000:2.0:1787864750.059324:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844844160:0@lo:104: 00010000:00010000:3.0:1787864750.059648:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787864750.059653:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.059659:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864750.059662:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.059669:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864750.059687:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864750.059692:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864750.061960:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864750.061972:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.061983:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc13d3c20) 00010000:00010000:3.0:1787864750.061986:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864750.061988:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062004:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864750.062025:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062029:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864750.062033:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062053:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc4336f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43376 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864750.062055:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787864750.062074:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864750.062079:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062083:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062086:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864750.062091:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062096:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864750.062104:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864750.062112:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062116:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864750.062118:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864750.062126:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d948e00/0x2fcb8c294dc43361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43368 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062137:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864750.062140:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864750.062143:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864750.062152:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864750.062155:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062162:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864750.062169:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062175:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc43353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4335a expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.062184:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864750.062186:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864750.062188:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864750.062214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844844288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864750.062270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864750.062344:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844844544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864750.062347:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844844416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864750.062389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864750.062474:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844288 00000100:00100000:2.0:1787864750.062481:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844288 00010000:00010000:2.0:1787864750.062508:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 24 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.062539:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844544 00000100:00100000:2.0:1787864750.062543:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844544 00010000:00010000:2.0:1787864750.062554:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 25 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.062583:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787864750.062591:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3640:x1874711844844288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864750.062604:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864750.062609:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 25 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062618:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 25 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062631:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31400/0x2fcb8c294dc43376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4336f expref: 25 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062645:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864750.062680:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844844288:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864750.062688:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787864750.062704:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787864750.062711:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3638:x1874711844844544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864750.062719:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864750.062723:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062731:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062741:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30200/0x2fcb8c294dc4335a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43353 expref: 23 pid: 6503 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.062759:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864750.062787:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844844544:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864750.062794:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787864750.063010:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844844544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864750.065076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864750.065181:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844844288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864750.065229:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844416 00000100:00100000:2.0:1787864750.065237:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844416 00010000:00010000:2.0:1787864750.065268:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864750.065304:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787864750.065314:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3637:x1874711844844416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864750.065326:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864750.065331:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.065341:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.065357:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc43368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc43361 expref: 22 pid: 6505 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.065376:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864750.065436:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3637:x1874711844844416:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864750.065444:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787864750.065603:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844844416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864750.069618:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864750.069633:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864750.069661:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864750.069669:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db31800/0x2fcb8c294dc4337d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc43384 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864750.069690:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864750.069692:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864750.069694:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864750.070001:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844844672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864750.070076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864750.070151:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844672 00000100:00100000:3.0:1787864750.070157:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844672 00010000:00010000:3.0:1787864750.070186:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 21 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864750.070228:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864750.070237:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:3639:x1874711844844672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864750.070262:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864750.070268:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 21 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.070278:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 21 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.070295:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30800/0x2fcb8c294dc43384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4337d expref: 21 pid: 6504 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.070308:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864750.070345:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3639:x1874711844844672:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.070351:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864750.070387:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844844672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864750.071015:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864750.071093:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864750.071229:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843520:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864750.071241:0:13174:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13174:1874711844843648:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864750.071284:0:13174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864750.071421:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892608 00000100:00100000:3.0:1787864750.071426:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892608 00010000:00010000:3.0:1787864750.071447:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 13 pid: 6503 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864750.071474:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892480 00000100:00100000:3.0:1787864750.071477:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892480 00010000:00010000:3.0:1787864750.071489:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 14 pid: 6505 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864750.071502:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:3.0:1787864750.071510:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+14:2409:x1874711825892608:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864750.071522:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864750.071534:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 14 pid: 6503 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071543:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 14 pid: 6503 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071556:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797c00/0x2fcb8c294dc4338b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac852 expref: 14 pid: 6503 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071567:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864750.071619:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825892608:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 109us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.071626:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:3.0:1787864750.071641:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:3.0:1787864750.071647:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:2410:x1874711825892480:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864750.071655:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864750.071660:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071669:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071678:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31000/0x2fcb8c294dc433a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac891 expref: 12 pid: 6505 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071690:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071698:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071717:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071724:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071730:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071737:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071743:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864750.071747:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071755:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071768:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864750.071776:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864750.071798:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2410:x1874711825892480:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 151us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864750.071805:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 45 00010000:00010000:2.0:1787864750.072460:0:13174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.072470:0:13174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864750.072476:0:13174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797e00/0x2fcb8c294dc433c3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864750.362590:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864750.362611:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844844800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864750.362679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864750.362834:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844800 00000100:00100000:1.0:1787864750.362842:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844800 00000100:00100000:1.0:1787864750.362909:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787864750.362919:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844844800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864750.362952:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864750.363007:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844844800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864750.363014:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787864750.363280:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844844800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864750.425168:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864750.873130:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844845056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864750.873199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864750.873285:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864750.873292:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844844928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864750.873317:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864750.873511:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845056 00000100:00100000:2.0:1787864750.873519:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845056 00000100:00100000:2.0:1787864750.873568:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844844928 00000100:00100000:2.0:1787864750.873571:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844844928 00000100:00100000:2.0:1787864750.873586:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787864750.873594:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844845056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864750.873622:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864750.873667:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844845056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864750.873675:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787864750.873691:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787864750.873698:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844844928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864750.873708:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864750.873732:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844844928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864750.873744:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1787864750.873918:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcbc000 x1874711844844928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864750.873936:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844844928:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1787864750.873949:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadbc00 x1874711844845056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864750.873959:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844845056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787864751.450024:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864751.577045:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864751.577052:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757de48800 from 7 10000000:01000000:0.0:1787864751.577065:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864751.577107:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.577119:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.577131:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.577156:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.577221:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.577319:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864751.577382:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845184 00000100:00100000:1.0:1787864751.577389:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845184 00000100:00100000:1.0:1787864751.577429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787864751.577438:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844845184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864751.577450:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864751.577463:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc433ca expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.577483:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.577494:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.577503:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949000, rc 0) 00000100:00100000:1.0:1787864751.577547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.577560:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787864751.577641:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.577653:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.577663:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.577720:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.577744:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.577766:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864751.577815:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845312 00000100:00100000:1.0:1787864751.577820:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845312 00000100:00100000:1.0:1787864751.577848:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787864751.577855:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.577963:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.577970:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787864751.578048:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.578074:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.578110:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864751.578164:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845440 00000100:00100000:1.0:1787864751.578168:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845440 00000100:00100000:1.0:1787864751.578189:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787864751.578195:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.578260:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.578267:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787864751.578363:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.578376:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787864751.579268:0:13231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787864751.579434:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787864751.579455:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864751.579464:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.579474:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864751.579483:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864751.579486:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757bdea800 from 7 10000000:01000000:0.0:1787864751.579488:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864751.579514:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.579522:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.579530:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.579548:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.579588:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.579661:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864751.579699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845568 00000100:00100000:1.0:1787864751.579704:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845568 00000100:00100000:1.0:1787864751.579769:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787864751.579778:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844845568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864751.579788:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864751.579800:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc433d8 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.579816:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.579825:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 22 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.579838:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948c00, rc 0) 00000100:00100000:1.0:1787864751.579938:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.579946:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787864751.580271:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.580283:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.580292:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.580355:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.580382:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.580439:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864751.580479:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845696 00000100:00100000:1.0:1787864751.580483:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845696 00000100:00100000:1.0:1787864751.580511:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787864751.580518:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.580601:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.580608:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787864751.580679:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.580702:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.580736:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.580756:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864751.580803:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845824 00000100:00100000:1.0:1787864751.580807:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845824 00000100:00100000:1.0:1787864751.580832:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1787864751.580837:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.580920:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.580927:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1787864751.581003:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787864751.581806:0:13232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787864751.582270:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787864751.582292:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864751.582300:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.582311:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864751.582333:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864751.582335:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927547df8000 from 7 10000000:01000000:1.0:1787864751.582338:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864751.582364:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.582371:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.582381:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864751.582398:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.582443:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864751.582490:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.582544:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844845952 00000100:00100000:0.0:1787864751.582550:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844845952 00000100:00100000:0.0:1787864751.582588:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787864751.582596:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844845952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.582607:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864751.582619:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc433e6 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.582638:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.582648:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.582655:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31400, rc 0) 00000100:00100000:0.0:1787864751.582692:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844845952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.582704:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1787864751.582742:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844845952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.582755:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.582763:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.582808:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.582833:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.582845:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.582854:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846080 00000100:00100000:0.0:1787864751.582857:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846080 00000100:00100000:0.0:1787864751.582874:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787864751.582880:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844846080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.582990:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844846080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.582997:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1787864751.583022:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.583061:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.583094:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.583111:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.583121:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846208 00000100:00100000:0.0:1787864751.583124:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846208 00000100:00100000:0.0:1787864751.583140:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787864751.583152:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844846208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.583219:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844846208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.583226:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1787864751.583262:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787864751.583939:0:13233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787864751.583981:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787864751.583996:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864751.584003:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584013:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864751.584022:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787864751.584024:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927548600000 from 7 10000000:01000000:0.0:1787864751.584039:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787864751.584061:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584069:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584078:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.584092:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584124:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.584152:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.584166:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846336 00000100:00100000:0.0:1787864751.584170:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846336 00000100:00100000:0.0:1787864751.584191:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787864751.584197:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844846336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.584205:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864751.584214:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc433f4 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584229:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584239:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584246:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30000, rc 0) 00000100:00100000:0.0:1787864751.584272:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844846336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.584279:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787864751.584306:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864751.584317:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864751.584325:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.584364:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584386:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.584404:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.584413:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846464 00000100:00100000:0.0:1787864751.584416:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846464 00000100:00100000:0.0:1787864751.584431:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787864751.584436:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844846464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584502:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844846464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.584509:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787864751.584533:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584555:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584590:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864751.584603:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864751.584613:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846592 00000100:00100000:0.0:1787864751.584616:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846592 00000100:00100000:0.0:1787864751.584632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787864751.584637:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844846592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864751.584698:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844846592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.584704:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787864751.584736:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844846592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787864751.585808:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787864751.586006:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787864751.586024:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864751.586041:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.586051:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864751.709439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864751.709481:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864751.709505:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864751.709525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864751.709548:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864751.709584:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892864 00000100:00100000:0.0:1787864751.709592:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892864 00000100:00100000:0.0:1787864751.709639:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893120 00000100:00100000:0.0:1787864751.709643:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893120 00000100:00100000:0.0:1787864751.709659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892992 00000100:00100000:0.0:1787864751.709661:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892992 00000100:00100000:0.0:1787864751.709671:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893248 00000100:00100000:0.0:1787864751.709673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893248 00000100:00100000:0.0:1787864751.709686:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 169 00000100:00100000:0.0:1787864751.709693:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825892864:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864751.709753:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825892864:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 61us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.709761:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 169 00000100:00100000:0.0:1787864751.709777:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 170 00000100:00100000:0.0:1787864751.709783:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825893120:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864751.709805:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825893120:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.709810:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 170 00000100:00100000:0.0:1787864751.709821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 171 00000100:00100000:0.0:1787864751.709826:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825892992:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864751.709848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fade580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825892992:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 22us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.709854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 171 00000100:00100000:0.0:1787864751.709864:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 172 00000100:00100000:0.0:1787864751.709870:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825893248:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864751.709939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825893248:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 68us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.709952:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 172 00000100:00080000:0.0:1787864751.709979:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864751.709983:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864751.710060:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825892736 00000100:00100000:3.0:1787864751.710064:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825892736 00000100:00100000:0.0:1787864751.716614:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 323 00000100:00100000:0.0:1787864751.716632:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2407:x1874711825892736:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864751.716708:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2407:x1874711825892736:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 82us (7279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864751.716717:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 323 00000100:00100000:3.0:1787864751.898753:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844846720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864751.898820:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1787864751.899093:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000020:00000080:1.0:1787864751.899098:0:8419:0:(genops.c:885:class_export_put()) final put ffff927448228800/d72d3621-0c17-4b0a-8f7a-94eec1706878 00000020:00000080:1.0:1787864751.899121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927448228800/d72d3621-0c17-4b0a-8f7a-94eec1706878 for lustre-OST0000 00000020:00000080:1.0:1787864751.899159:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744822d800 for lustre-OST0000 00000100:00100000:2.0:1787864751.899388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846720 00000100:00100000:2.0:1787864751.899396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846720 00000100:00100000:2.0:1787864751.899447:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864751.899457:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844846720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864751.899487:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864751.899538:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844846720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864751.899544:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864751.899588:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844846720:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1787864751.899726:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000020:00000080:2.0:1787864751.899730:0:9504:0:(genops.c:885:class_export_put()) final put ffff92744839c800/d72d3621-0c17-4b0a-8f7a-94eec1706878 00000100:00100000:2.0:1787864751.901608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864751.901640:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893376 00000100:00100000:2.0:1787864751.901648:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893376 00000100:00100000:2.0:1787864751.901690:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 324 00000100:00100000:2.0:1787864751.901699:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:6199:x1874711825893376:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864751.901713:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864751.901730:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8c2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864751.901755:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864751.901767:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864751.901783:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797000, rc 0) 00000100:00100000:2.0:1787864751.901831:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893376:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 134us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864751.901839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 324 00000020:00000080:1.0:1787864751.904871:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92744839c800/d72d3621-0c17-4b0a-8f7a-94eec1706878 for lustre-OST0001 00000020:00000080:1.0:1787864751.904943:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744839b800 for lustre-OST0001 00000100:00100000:0.0:1787864751.907312:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864751.908645:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893504 00000100:00100000:1.0:1787864751.908656:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893504 00000100:00100000:1.0:1787864751.908714:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 325 00000100:00100000:1.0:1787864751.908724:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893504:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.908866:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893504:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 143us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.908875:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 325 00000100:00100000:0.0:1787864751.911438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864751.911510:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893632 00000100:00100000:3.0:1787864751.911519:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893632 00000100:00100000:3.0:1787864751.911570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 326 00000100:00100000:3.0:1787864751.911579:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893632:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864751.911701:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893632:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 122us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864751.911710:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 326 00000100:00100000:0.0:1787864751.929239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864751.929569:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893760 00000100:00100000:1.0:1787864751.929580:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893760 00000100:00100000:1.0:1787864751.929663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 327 00000100:00100000:1.0:1787864751.929675:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825893760:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864751.929694:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864751.929713:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8c9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.929744:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.929756:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864751.929766:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949e00, rc 0) 00000100:00100000:1.0:1787864751.929828:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825893760:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 155us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.929837:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 327 00000100:00100000:3.0:1787864751.937057:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864751.937153:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825893888 00000100:00100000:1.0:1787864751.937168:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825893888 00000100:00100000:1.0:1787864751.937227:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 328 00000100:00100000:1.0:1787864751.937236:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825893888:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.937372:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825893888:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.937381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 328 00000100:00100000:1.0:1787864751.942365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864751.942403:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894016 00000100:00100000:1.0:1787864751.942411:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894016 00000100:00100000:1.0:1787864751.942455:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 329 00000100:00100000:1.0:1787864751.942465:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825894016:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864751.942747:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825894016:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 282us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864751.942755:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 329 00010000:00010000:3.0:1787864752.473072:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864753.497782:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864753.516814:0:13373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787864754.458260:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864754.458289:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844846848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864754.458364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864754.458447:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844847232:0@lo:400:kworker.0 00000100:00100000:3.0:1787864754.458471:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846848 00000100:00100000:3.0:1787864754.458485:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846848 00000100:00100000:2.0:1787864754.458493:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.458561:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844847104:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.458598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864754.458608:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844846976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.458630:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844847616:0@lo:400:kworker.0 00000100:00100000:0.0:1787864754.458654:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.458662:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.458681:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844848128:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.458708:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.458745:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847104 00000100:00100000:1.0:1787864754.458751:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847104 00000100:00100000:1.0:1787864754.458801:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847616 00000100:00100000:1.0:1787864754.458811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847616 00000100:00100000:1.0:1787864754.458838:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848128 00000100:00100000:1.0:1787864754.458841:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848128 00000100:00100000:1.0:1787864754.458858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787864754.458865:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844847104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.458945:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844847104:12345-0@lo:400:kworker.0 Request processed in 80us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864754.458952:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787864754.458972:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787864754.458979:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459004:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844847616:12345-0@lo:400:kworker.0 Request processed in 28us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864754.459010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787864754.459032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787864754.459038:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844848128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459061:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844848128:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864754.459067:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787864754.459096:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844847360:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.459134:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844847872:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.459169:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844848384:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.459202:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787864754.459208:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844847744:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.459252:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dcced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844848256:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.459599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864754.459630:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847872 00000100:00100000:1.0:1787864754.459635:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847872 00000100:00100000:1.0:1787864754.459665:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848384 00000100:00100000:1.0:1787864754.459668:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848384 00000100:00100000:0.0:1787864754.463624:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844847488:0@lo:400:kworker.0 00000100:00100000:0.0:1787864754.463752:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864754.463781:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844848000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864754.463800:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844846976 00000100:00100000:3.0:1787864754.463809:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844846976 00000100:00100000:0.0:1787864754.463813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864754.463856:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787864754.463865:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844846976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864754.463953:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844846976:12345-0@lo:400:kworker.0 Request processed in 89us (5301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864754.463960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1787864754.463991:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847232 00000100:00100000:3.0:1787864754.463996:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847232 00000100:00100000:3.0:1787864754.464029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847488 00000100:00100000:3.0:1787864754.464032:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847488 00000100:00100000:3.0:1787864754.464056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787864754.464063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844847232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864754.464113:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844847232:12345-0@lo:400:kworker.0 Request processed in 50us (5621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864754.464119:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787864754.464131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787864754.464136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844847488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864754.464162:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844847488:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864754.464168:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787864754.464266:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787864754.464277:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844846848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864754.464301:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864754.464334:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844846848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (5970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864754.464341:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787864754.464377:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844847232:0@lo:400:kworker.0 00010000:00080000:2.0:1787864754.464390:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadf840 x1874711844846848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864754.464406:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844846848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864754.464468:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847360 00000100:00100000:2.0:1787864754.464472:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847360 00000100:00100000:2.0:1787864754.464497:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844847744 00000100:00100000:2.0:1787864754.464499:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844847744 00000100:00100000:2.0:1787864754.464606:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848256 00000100:00100000:2.0:1787864754.464616:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848256 00000100:00100000:2.0:1787864754.464636:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787864754.464642:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844847360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864754.464695:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844847360:12345-0@lo:400:kworker.0 Request processed in 53us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864754.464702:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787864754.464714:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787864754.464719:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844847744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864754.464746:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844847744:12345-0@lo:400:kworker.0 Request processed in 27us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864754.464751:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787864754.464762:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787864754.464768:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844848256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864754.464795:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844848256:12345-0@lo:400:kworker.0 Request processed in 28us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864754.464800:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787864754.466010:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848000 00000100:00100000:1.0:1787864754.466027:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848000 00000100:00100000:0.0:1787864754.466037:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844848512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864754.466074:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787864754.466083:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864754.466088:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864754.466139:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844846976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.466141:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844847872:12345-0@lo:400:kworker.0 Request processed in 57us (6983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864754.466151:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787864754.466158:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844847488:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.466170:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787864754.466178:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844848384:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787864754.466198:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864754.466205:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864754.466208:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844848384:12345-0@lo:400:kworker.0 Request processed in 31us (7018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864754.466214:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787864754.466222:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864754.466226:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864754.466237:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787864754.466246:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844848000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864754.466246:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848512 00000100:00100000:0.0:1787864754.466252:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848512 00000100:00100000:0.0:1787864754.466289:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864754.466294:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844848000:12345-0@lo:400:kworker.0 Request processed in 47us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864754.466301:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844848512:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864754.466317:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00002000:00000024:0.0:1787864754.466321:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864754.466357:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844848512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864754.466363:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1787864754.466394:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad83c0 x1874711844848000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.466404:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844848000:0@lo:400:kworker.0 00010000:00080000:0.0:1787864754.466413:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9275589983c0 x1874711844848512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.466426:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844848512:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1787864754.466480:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadbc00 x1874711844847744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.466489:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844847744:0@lo:400:kworker.0 00010000:00080000:0.0:1787864754.466499:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dcced00 x1874711844848256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.467228:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dcced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844848256:0@lo:400:kworker.0 00000100:00100000:0.0:1787864754.467253:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844847360:0@lo:400:kworker.0 00010000:00080000:0.0:1787864754.467266:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada580 x1874711844847872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.467285:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844847872:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.467304:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844847104:0@lo:400:kworker.0 00010000:00080000:0.0:1787864754.467305:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dccfc00 x1874711844848384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864754.467320:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844848384:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.467328:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844847616:0@lo:400:kworker.0 00000100:00100000:1.0:1787864754.468686:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844848128:0@lo:400:kworker.0 00010000:00010000:2.0:1787864754.523239:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864755.481294:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864755.481320:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844848640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864755.481390:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864755.481589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848640 00000100:00100000:3.0:1787864755.481598:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848640 00000100:00100000:3.0:1787864755.481655:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864755.481664:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844848640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864755.481696:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864755.481755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844848640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864755.481762:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787864755.481919:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844848640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864755.546606:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864755.993243:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844848768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864755.993316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864755.994307:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848768 00000100:00100000:1.0:1787864755.994316:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848768 00000100:00100000:1.0:1787864755.994374:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787864755.994385:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844848768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864755.994416:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864755.994477:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844848768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864755.994484:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1787864755.994545:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbb8f00 x1874711844848768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864755.994565:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844848768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864755.995483:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844848896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864755.995614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864755.995771:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844848896 00000100:00100000:1.0:1787864755.995777:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844848896 00000100:00100000:1.0:1787864755.995823:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864755.995830:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844848896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864755.995847:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864755.996202:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844848896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 371us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864755.996211:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1787864755.996292:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcbe940 x1874711844848896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864755.996307:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844848896:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787864756.569132:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864756.839415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864756.839518:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894144 00000100:00100000:1.0:1787864756.839530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894144 00000100:00100000:1.0:1787864756.839607:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 331 00000100:00100000:1.0:1787864756.839618:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825894144:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864756.839778:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864756.839856:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825894144:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 238us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864756.839863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864756.839865:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 331 00000100:00100000:3.0:1787864756.839884:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864756.839949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894400 00000100:00100000:1.0:1787864756.839954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894400 00000100:00100000:1.0:1787864756.839994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894656 00000100:00100000:1.0:1787864756.839998:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894656 00000100:00100000:1.0:1787864756.840030:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894272 00000100:00100000:1.0:1787864756.840033:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894272 00000100:00100000:1.0:1787864756.840051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 179 00000100:00100000:1.0:1787864756.840059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825894400:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864756.840100:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825894400:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 41us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864756.840107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 179 00000100:00100000:1.0:1787864756.840120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:1.0:1787864756.840126:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825894656:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864756.840149:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825894656:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864756.840155:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:1.0:1787864756.840167:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00100000:1.0:1787864756.840173:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825894272:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864756.840197:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825894272:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864756.840202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00080000:1.0:1787864756.840220:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864756.840224:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864756.840432:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864756.840464:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894528 00000100:00100000:3.0:1787864756.840469:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894528 00000100:00100000:3.0:1787864756.840500:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00100000:3.0:1787864756.840508:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825894528:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864756.840637:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825894528:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 129us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864756.840644:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00080000:1.0:1787864756.841426:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864757.017564:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864757.017601:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844849024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864757.017695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864757.017770:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849024 00000100:00100000:0.0:1787864757.017780:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849024 00000100:00100000:0.0:1787864757.017853:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787864757.017867:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844849024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864757.017940:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787864757.018021:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844849024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 156us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864757.018030:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787864757.018079:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844849024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864757.596670:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864758.092267:0:13521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:05:56 (1787864756) === 00000100:00100000:1.0:1787864758.378032:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.378125:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894912 00000100:00100000:2.0:1787864758.378134:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894912 00000100:00100000:2.0:1787864758.378200:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:2.0:1787864758.378210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:10514:x1874711825894912:12345-192.168.206.36@tcp:700:mkdir.0 00000100:00100000:2.0:1787864758.378284:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:10514:x1874711825894912:12345-192.168.206.36@tcp:700:mkdir.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.378292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00080000:1.0:1787864758.378766:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864758.382603:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.382751:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825894784 00000100:00100000:2.0:1787864758.382769:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825894784 00000100:00100000:2.0:1787864758.382839:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:2.0:1787864758.382856:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825894784:12345-192.168.206.36@tcp:41:mkdir.0 00000004:00000024:2.0:1787864758.382941:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864758.383376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825894784:12345-192.168.206.36@tcp:41:mkdir.0 Request processed in 524us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.383386:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:3.0:1787864758.383648:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.384063:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895168 00000100:00100000:2.0:1787864758.384071:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895168 00000100:00100000:2.0:1787864758.384117:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:2.0:1787864758.384127:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+6:10514:x1874711825895168:12345-192.168.206.36@tcp:36:mkdir.0 00010000:00010000:2.0:1787864758.384659:0:10168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864758.384701:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc432b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac83d expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.384726:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864758.384737:0:10168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864758.384844:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.384859:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.384869:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385190:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385228:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385240:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385756:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385768:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385775:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864758.385789:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004562a73a reply state 0000000081d27fb7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385800:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385808:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:2.0:1787864758.385811:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864758.385815:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787864758.385820:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787864758.385827:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.385833:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386149:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386162:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864758.386166:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386174:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386186:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154b00) 00010000:00010000:2.0:1787864758.386188:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864758.386192:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386197:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43410 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864758.386213:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004562a73a reply state 0000000081d27fb7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386221:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.386227:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927448154200) 00010000:00010000:2.0:1787864758.386229:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864758.386231:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787864758.386542:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10514:x1874711825895168:12345-192.168.206.36@tcp:36:mkdir.0 Request processed in 2411us (2889us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787864758.386551:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864758.399180:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.401345:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895296 00000100:00100000:2.0:1787864758.401359:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895296 00000100:00100000:2.0:1787864758.401429:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:2.0:1787864758.401453:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10515:x1874711825895296:12345-192.168.206.36@tcp:101:chmod.0 00010000:00010000:2.0:1787864758.401473:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864758.401494:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43425 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8d0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401554:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401566:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401576:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864758.401615:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787864758.401620:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864758.401658:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401682:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43425 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d0 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401700:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d0 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.401708:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154b00) 00010000:00010000:2.0:1787864758.401710:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864758.401713:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:2.0:1787864758.401780:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+8:10515:x1874711825895296:12345-192.168.206.36@tcp:101:chmod.0 Request processed in 330us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.401796:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:0.0:1787864758.406309:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.406385:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895552 00000100:00100000:2.0:1787864758.406393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895552 00000100:00100000:2.0:1787864758.406450:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:2.0:1787864758.406459:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:10515:x1874711825895552:12345-192.168.206.36@tcp:36:chmod.0 00010000:00010000:2.0:1787864758.406506:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864758.406529:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4342c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d0 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.406547:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154b00) 00010000:00010000:2.0:1787864758.406556:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864758.406577:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.406588:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.406597:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864758.406779:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9c70c17 reply state 00000000c42ff5f5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.406792:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.406799:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:2.0:1787864758.406801:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787864758.406805:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787864758.406818:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787864758.406923:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:10515:x1874711825895552:12345-192.168.206.36@tcp:36:chmod.0 Request processed in 463us (622us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787864758.406932:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:3.0:1787864758.429415:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.429547:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895680 00000100:00100000:2.0:1787864758.429558:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895680 00000100:00100000:2.0:1787864758.429638:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:2.0:1787864758.429650:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+9:10516:x1874711825895680:12345-192.168.206.36@tcp:101:chown.0 00010000:00010000:2.0:1787864758.429681:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864758.429707:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4343a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8d7 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.429795:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.429812:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.429825:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864758.430031:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787864758.430037:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864758.430092:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.430123:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4343a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d7 expref: 11 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.430146:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d7 expref: 10 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.430172:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:2.0:1787864758.430176:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864758.430180:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797a00, rc 0) 00000100:00100000:2.0:1787864758.430449:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+10:10516:x1874711825895680:12345-192.168.206.36@tcp:101:chown.0 Request processed in 800us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.430457:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:1.0:1787864758.433782:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864758.434387:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895808 00000100:00100000:0.0:1787864758.434415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895808 00000100:00100000:0.0:1787864758.434482:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:0.0:1787864758.434490:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:10516:x1874711825895808:12345-192.168.206.36@tcp:101:chown.0 00010000:00010000:0.0:1787864758.434512:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864758.434537:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8de expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434634:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434651:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434664:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434676:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434684:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.434691:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435107:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435119:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435127:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864758.435208:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787864758.435213:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864758.435240:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435253:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435260:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435266:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435272:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.435276:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435284:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435297:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:0.0:1787864758.435301:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864758.435306:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435312:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4344f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435325:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435339:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435345:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435350:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.435354:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435361:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435370:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927448154200) 00010000:00010000:0.0:1787864758.435373:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864758.435377:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435383:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc43456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435414:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8de expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435426:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8de expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.435434:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:0.0:1787864758.435436:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864758.435445:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31800, rc 0) 00000100:00100000:0.0:1787864758.435539:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10516:x1874711825895808:12345-192.168.206.36@tcp:101:chown.0 Request processed in 1048us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864758.435549:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:0.0:1787864758.438497:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864758.438670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825895936 00000100:00100000:3.0:1787864758.438681:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825895936 00000100:00100000:3.0:1787864758.438784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:3.0:1787864758.438797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10516:x1874711825895936:12345-192.168.206.36@tcp:900:chown.0 00000100:00100000:3.0:1787864758.438945:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10516:x1874711825895936:12345-192.168.206.36@tcp:900:chown.0 Request processed in 149us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864758.439192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:3.0:1787864758.441446:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864758.441562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825896192 00000100:00100000:0.0:1787864758.441572:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825896192 00000100:00100000:0.0:1787864758.441639:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:0.0:1787864758.441650:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10516:x1874711825896192:12345-192.168.206.36@tcp:36:chown.0 00010000:00010000:0.0:1787864758.441717:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864758.441751:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4345d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8de expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.441772:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:0.0:1787864758.441777:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864758.441806:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.441822:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.441837:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864758.444354:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1787864758.444585:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444597:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444618:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444625:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.444629:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444638:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444654:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927448154200) 00010000:00010000:0.0:1787864758.444657:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864758.444661:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444668:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43417 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444687:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444693:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444698:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444703:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.444705:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444720:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444729:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:0.0:1787864758.444732:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864758.444734:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444740:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4341e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444752:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444757:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444763:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444768:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.444770:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444776:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444783:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:0.0:1787864758.444785:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787864758.444789:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.444805:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43433 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864758.444947:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f04bf845 reply state 00000000b65183a6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.444961:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.444969:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:1.0:1787864758.444971:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787864758.444974:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787864758.444984:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1787864758.445080:0:6512:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787864758.445094:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10516:x1874711825896192:12345-192.168.206.36@tcp:36:chown.0 Request processed in 3442us (3653us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787864758.445103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 28 00010000:00010000:2.0:1787864758.445824:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445834:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445841:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445846:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864758.445850:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445856:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445866:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927448154900) 00010000:00010000:2.0:1787864758.445868:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864758.445871:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.445876:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31000/0x2fcb8c294dc43464 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864758.460329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.460493:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825896320 00000100:00100000:2.0:1787864758.460502:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825896320 00000100:00100000:2.0:1787864758.460648:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:2.0:1787864758.460659:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:10517:x1874711825896320:12345-192.168.206.36@tcp:101:touch.500 00010000:00010000:2.0:1787864758.460681:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864758.460700:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4346b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8e5 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787864758.464607:0:8448:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3858us 00010000:00010000:3.0:1787864758.475387:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475416:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475429:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475445:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475452:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475470:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475598:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475607:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475614:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864758.475644:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864758.475648:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864758.475688:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475701:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475716:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475723:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475729:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824fe00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864758.475733:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475740:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475752:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:3.0:1787864758.475755:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864758.475759:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475764:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475775:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475780:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475785:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475789:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ec00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864758.475797:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475803:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475811:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927543a2e300) 00010000:00010000:3.0:1787864758.475813:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864758.475816:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475821:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43479 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475857:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc4346b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8e5 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475872:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8e5 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.475881:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:3.0:1787864758.475883:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787864758.475885:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f000, rc 0) 00000100:00100000:3.0:1787864758.475980:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10517:x1874711825896320:12345-192.168.206.36@tcp:101:touch.500 Request processed in 15322us (15659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864758.475989:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:0.0:1787864758.479428:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864758.479473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825896576 00000100:00100000:0.0:1787864758.479481:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825896576 00000100:00100000:0.0:1787864758.479530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:0.0:1787864758.479540:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10517:x1874711825896576:12345-192.168.206.36@tcp:101:touch.500 00010000:00010000:0.0:1787864758.479559:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864758.479578:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43487 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479678:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479692:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479702:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479782:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479791:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.479797:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864758.481273:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787864758.481432:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc4349c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482480:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc4349c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482493:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc4349c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482543:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482551:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482557:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482563:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864758.482567:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482574:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482586:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:0.0:1787864758.482589:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864758.482594:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482615:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc4348e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864758.482628:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000236296b2 reply state 000000002f5954da transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482640:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482646:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1347dc18 (ffff927554cab100) 00010000:00010000:0.0:1787864758.482648:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864758.482651:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787864758.482693:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43487 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8ec expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482706:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc4349c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8ec expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.482712:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927554cabb00) 00010000:00010000:0.0:1787864758.482714:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864758.482716:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31a00, rc 0) 00000100:00100000:0.0:1787864758.482804:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:10517:x1874711825896576:12345-192.168.206.36@tcp:101:touch.500 Request processed in 3265us (3382us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787864758.482813:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:3.0:1787864758.485663:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864758.485736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825896832 00000100:00100000:1.0:1787864758.485745:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825896832 00000100:00100000:1.0:1787864758.485929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:1.0:1787864758.486052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+10:10517:x1874711825896832:12345-192.168.206.36@tcp:36:touch.500 00010000:00010000:1.0:1787864758.486104:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864758.486130:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc4349c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8ec expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.486150:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927554cabb00) 00010000:00010000:1.0:1787864758.486160:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864758.486213:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.486252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.486262:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864758.486364:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ee71b7f reply state 000000009857941a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.486376:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.486382:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:1.0:1787864758.486384:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787864758.486387:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864758.486482:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10517:x1874711825896832:12345-192.168.206.36@tcp:36:touch.500 Request processed in 543us (826us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787864758.486489:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:1.0:1787864758.490160:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864758.490412:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825896960 00000100:00100000:3.0:1787864758.490420:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825896960 00000100:00100000:3.0:1787864758.490478:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:3.0:1787864758.490499:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+11:10517:x1874711825896960:12345-192.168.206.36@tcp:101:touch.500 00010000:00010000:3.0:1787864758.490521:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864758.490539:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc434b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8f3 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.490592:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc434b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8f3 expref: 12 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.490607:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc434b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8f3 expref: 12 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.490625:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:3.0:1787864758.490628:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864758.490632:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ec00, rc 0) 00000100:00100000:3.0:1787864758.492562:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+12:10517:x1874711825896960:12345-192.168.206.36@tcp:101:touch.500 Request processed in 2056us (2403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864758.492573:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:0.0:1787864758.501459:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864758.502163:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897088 00000100:00100000:1.0:1787864758.502174:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897088 00000100:00100000:1.0:1787864758.502255:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:1.0:1787864758.502263:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1874711825897088:12345-192.168.206.36@tcp:8:touch.500 00010000:00080000:1.0:1787864758.502299:0:8426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1787864758.502329:0:8426:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc434b8 00002000:00100000:1.0:1787864758.502339:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 545fdf19-2645-4c06-a6f5-05dea3348b20/ffff927447ebd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787864758.502355:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:1.0:1787864758.502435:0:8426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787864758.502465:0:8426:0:(import.c:65:import_set_state_nolock()) ffff927447eb8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787864758.502542:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825897088:12345-192.168.206.36@tcp:8:touch.500 Request processed in 277us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864758.502551:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:0.0:1787864758.507211:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864758.507296:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897216 00000100:00100000:3.0:1787864758.507310:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897216 00000100:00100000:3.0:1787864758.507418:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:3.0:1787864758.507430:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825897216:12345-192.168.206.36@tcp:2:touch.500 00000100:00080000:2.0:1787864758.507791:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787864758.517604:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:3.0:1787864758.517619:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000100:00100000:0.0:1787864758.517846:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:0:x1874711825897216:12345-192.168.206.36@tcp:2:touch.500 Request processed in 10413us (10794us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787864758.517873:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:3.0:1787864758.524826:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.524927:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897472 00000100:00100000:2.0:1787864758.524937:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897472 00000100:00100000:2.0:1787864758.525002:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:2.0:1787864758.525012:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+12:10517:x1874711825897472:12345-192.168.206.36@tcp:35:touch.500 00000100:00100000:2.0:1787864758.525284:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+13:10517:x1874711825897472:12345-192.168.206.36@tcp:35:touch.500 Request processed in 273us (466us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787864758.525293:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:1.0:1787864758.540439:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864758.540538:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897600 00000100:00100000:0.0:1787864758.540547:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897600 00000100:00100000:0.0:1787864758.540607:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:0.0:1787864758.540616:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+13:10518:x1874711825897600:12345-192.168.206.36@tcp:101:rm.0 00010000:00010000:0.0:1787864758.540638:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864758.540658:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc434bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac8fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540719:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540733:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540745:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864758.540783:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787864758.540786:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864758.540820:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540843:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc434bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8fa expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540859:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8fa expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.540884:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:0.0:1787864758.541018:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864758.541022:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31800, rc 0) 00000100:00100000:0.0:1787864758.541090:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+14:10518:x1874711825897600:12345-192.168.206.36@tcp:101:rm.0 Request processed in 475us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864758.541097:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:0.0:1787864758.544681:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864758.544798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897856 00000100:00100000:1.0:1787864758.544810:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897856 00000100:00100000:1.0:1787864758.545547:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:1.0:1787864758.545567:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+14:10518:x1874711825897856:12345-192.168.206.36@tcp:101:rm.0 00010000:00010000:1.0:1787864758.545594:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864758.545620:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc434cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac901 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864758.545756:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787864758.545966:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc434cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac901 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.545984:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:1.0:1787864758.545988:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864758.546006:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc434cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac901 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.546033:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948400, rc 0) 00000100:00100000:1.0:1787864758.546124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+15:10518:x1874711825897856:12345-192.168.206.36@tcp:101:rm.0 Request processed in 564us (1454us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787864758.546132:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:3.0:1787864758.552966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.553474:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825897984 00000100:00100000:2.0:1787864758.553486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825897984 00000100:00100000:2.0:1787864758.553549:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:2.0:1787864758.553559:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+15:10518:x1874711825897984:12345-192.168.206.36@tcp:37:rm.0 00000100:00100000:2.0:1787864758.565497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+15:10518:x1874711825897984:12345-192.168.206.36@tcp:37:rm.0 Request processed in 11922us (12529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.565513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:0.0:1787864758.572834:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864758.573060:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825898240 00000100:00100000:3.0:1787864758.573073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825898240 00000100:00100000:3.0:1787864758.573175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864758.573188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548b69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+15:10518:x1874711825898240:12345-192.168.206.36@tcp:35:rm.0 00000100:00100000:3.0:1787864758.573520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548b69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+16:10518:x1874711825898240:12345-192.168.206.36@tcp:35:rm.0 Request processed in 334us (697us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787864758.573532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864758.583189:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.583858:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825898496 00000100:00100000:2.0:1787864758.583873:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825898496 00000100:00100000:2.0:1787864758.584000:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:2.0:1787864758.584013:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+16:10518:x1874711825898496:12345-192.168.206.36@tcp:101:rm.0 00010000:00010000:2.0:1787864758.584042:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864758.584068:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc434db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac908 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.584191:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc434e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.584220:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc434e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.584234:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc434e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864758.584246:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787864758.584423:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc434db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac908 expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.584444:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc434e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac908 expref: 18 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.584453:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:2.0:1787864758.584457:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864758.584461:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:2.0:1787864758.584530:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825898496:12345-192.168.206.36@tcp:101:rm.0 Request processed in 521us (1356us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787864758.584538:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:0.0:1787864758.589694:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.589846:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825898624 00000100:00100000:2.0:1787864758.589877:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825898624 00000100:00100000:2.0:1787864758.589976:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:2.0:1787864758.589985:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825898624:12345-192.168.206.36@tcp:41:rm.0 00000004:00000024:2.0:1787864758.590044:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787864758.590110:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825898624:12345-192.168.206.36@tcp:41:rm.0 Request processed in 126us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864758.590117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:0.0:1787864758.595310:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864758.595461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825898752 00000100:00100000:1.0:1787864758.595487:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825898752 00000100:00100000:1.0:1787864758.595560:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:1.0:1787864758.595571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825898752:12345-192.168.206.36@tcp:101:rm.0 00010000:00010000:1.0:1787864758.595596:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864758.595621:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc434f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac90f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595698:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595730:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595743:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595751:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.595758:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598354:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598385:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598399:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864758.598542:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787864758.598548:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864758.598576:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598590:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598600:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598606:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598613:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598619:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864758.598624:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598631:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598645:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:1.0:1787864758.598648:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864758.598653:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598660:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949a00/0x2fcb8c294dc434f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598751:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598757:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598763:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598768:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864758.598771:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598777:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598785:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1347dc18 (ffff927554cab100) 00010000:00010000:1.0:1787864758.598788:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864758.598792:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598797:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc434fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598837:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc434f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac90f expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598851:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac90f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864758.598870:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:1.0:1787864758.598873:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864758.598876:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948400, rc 0) 00000100:00100000:1.0:1787864758.599072:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:10518:x1874711825898752:12345-192.168.206.36@tcp:101:rm.0 Request processed in 3500us (3773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864758.599082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:1.0:1787864758.602719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.603725:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899008 00000100:00100000:2.0:1787864758.603739:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899008 00000100:00100000:2.0:1787864758.603816:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:2.0:1787864758.603826:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+19:10518:x1874711825899008:12345-192.168.206.36@tcp:36:rm.0 00010000:00010000:2.0:1787864758.604088:0:10168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787864758.604118:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43505 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac90f expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604140:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc434b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8f3 expref: 18 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604224:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:2.0:1787864758.604237:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc434c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8fa expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604246:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:2.0:1787864758.604249:0:10168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864758.604268:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604280:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604303:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604315:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604322:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604328:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604407:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604415:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604421:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864758.604613:0:10168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787864758.604622:0:10168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 283666732180ns, next at 284666730187ns, rc = 0 00010000:00010000:2.0:1787864758.604663:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604671:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604678:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604695:0:10168:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604701:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604706:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604730:0:10168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864758.604749:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604756:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604762:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604768:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864758.604772:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.604779:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604796:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864758.604797:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:2.0:1787864758.604804:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787864758.604810:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604814:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604844:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864758.604849:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4351a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604852:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604864:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604911:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:0.0:1787864758.604915:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787864758.604920:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604931:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc43521 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864758.604968:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864758.604970:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864758.604972:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864758.605973:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.605981:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.605989:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606004:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864758.606007:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606014:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606026:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:2.0:1787864758.606028:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864758.606032:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606038:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4350c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864758.606049:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000070b4cf2 reply state 000000006ca34cd3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606060:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864758.606078:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1347dc18 (ffff927554cab100) 00010000:00010000:2.0:1787864758.606080:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864758.606083:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864758.606173:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825899008:12345-192.168.206.36@tcp:36:rm.0 Request processed in 2346us (3464us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787864758.606181:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:0.0:1787864758.610646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864758.610751:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899264 00000100:00100000:2.0:1787864758.610765:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899264 00000100:00100000:2.0:1787864758.610837:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:2.0:1787864758.610849:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825899264:12345-192.168.206.36@tcp:35:rm.0 00000100:00100000:2.0:1787864758.611314:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+19:10518:x1874711825899264:12345-192.168.206.36@tcp:35:rm.0 Request processed in 465us (681us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787864758.611324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00010000:00010000:0.0:1787864758.617106:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864758.619126:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864758.619228:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899520 00000100:00100000:3.0:1787864758.619313:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899520 00000100:00100000:3.0:1787864758.619425:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:3.0:1787864758.619437:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+19:10518:x1874711825899520:12345-192.168.206.36@tcp:36:rm.0 00010000:00010000:3.0:1787864758.619524:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787864758.619559:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc434e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac908 expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619586:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43480 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8e5 expref: 18 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619599:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2ec00) 00010000:00010000:3.0:1787864758.619617:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc43441 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8d7 expref: 17 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619626:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448154000) 00010000:00010000:3.0:1787864758.619633:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864758.619663:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619678:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619707:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619722:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619729:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619737:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619832:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619841:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.619848:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864758.620207:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787864758.620226:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620234:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620386:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620392:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864758.620405:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620413:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620423:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff927543a2e200) 00010000:00010000:3.0:1787864758.620427:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787864758.620431:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620437:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43536 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620458:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.620984:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621003:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621009:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824fe00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864758.621013:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621020:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621030:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927543a2ea00) 00010000:00010000:3.0:1787864758.621033:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864758.621046:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621052:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824fe00/0x2fcb8c294dc43528 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864758.621069:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000549d6c39 reply state 000000006756529a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621082:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864758.621090:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927543a2e900) 00010000:00010000:3.0:1787864758.621092:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864758.621095:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864758.621202:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+18:10518:x1874711825899520:12345-192.168.206.36@tcp:36:rm.0 Request processed in 1763us (2085us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787864758.621213:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:3.0:1787864759.577264:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844849152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864759.577341:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864759.577392:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849152 00000100:00100000:1.0:1787864759.577407:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849152 00000100:00080000:3.0:1787864759.577471:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864759.577502:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787864759.577515:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844849152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864759.577544:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864759.577630:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844849152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864759.577642:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787864759.577676:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbded00 x1874711844849152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864759.577696:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844849152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864759.579193:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844849280:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.579308:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.579362:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844849792:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.579394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864759.579513:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849792 00000100:00100000:2.0:1787864759.579522:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849792 00000100:00100000:2.0:1787864759.579583:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787864759.579591:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844849792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.579996:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844850304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864759.580002:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844849792:12345-0@lo:400:kworker.0 Request processed in 407us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864759.580020:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787864759.580052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.580258:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844849792:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.580292:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850816:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.580320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864759.580526:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844849536:0@lo:400:kworker.0 00000100:00100000:1.0:1787864759.580590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864759.580631:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844850048:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.580641:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787864759.580654:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844849408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864759.580665:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.580693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.580718:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844849920:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.580742:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.580780:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850432:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.580809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864759.580832:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850304 00000100:00100000:2.0:1787864759.580839:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850304 00000100:00100000:3.0:1787864759.580840:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849280 00000100:00100000:3.0:1787864759.580842:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849280 00000100:00100000:3.0:1787864759.580886:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1787864759.580983:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844849280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.581048:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844849280:12345-0@lo:400:kworker.0 Request processed in 67us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.581057:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1787864759.581066:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850816 00000100:00100000:2.0:1787864759.581070:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850816 00000100:00100000:2.0:1787864759.581094:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850432 00000100:00100000:2.0:1787864759.581097:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850432 00000100:00100000:1.0:1787864759.581227:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844850560:0@lo:400:kworker.0 00000100:00100000:1.0:1787864759.581268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864759.581291:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849536 00000100:00100000:3.0:1787864759.581295:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864759.581300:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849536 00000100:00100000:1.0:1787864759.581305:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787864759.581315:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844850304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864759.581316:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787864759.581322:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844849664:0@lo:400:kworker.0 00000100:00100000:2.0:1787864759.581344:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581358:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850048 00000100:00100000:0.0:1787864759.581364:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850048 00000100:00100000:1.0:1787864759.581383:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.581391:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844850304:12345-0@lo:400:kworker.0 Request processed in 82us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864759.581402:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850816:12345-0@lo:400:kworker.0 Request processed in 65us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.581408:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787864759.581408:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850560 00000100:00100000:2.0:1787864759.581416:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787864759.581417:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850560 00000100:00100000:3.0:1787864759.581440:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864759.581457:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844850176:0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581458:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787864759.581467:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581480:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844849536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864759.581507:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864759.581534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844850688:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.581536:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850432:12345-0@lo:400:kworker.0 Request processed in 76us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.581553:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864759.581579:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864759.581586:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849408 00000100:00100000:3.0:1787864759.581593:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849408 00000100:00100000:1.0:1787864759.581619:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850176 00000100:00100000:1.0:1787864759.581626:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850176 00000100:00100000:1.0:1787864759.581655:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850688 00000100:00100000:1.0:1787864759.581658:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850688 00000100:00100000:1.0:1787864759.581688:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787864759.581696:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581823:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448116940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844849536:12345-0@lo:400:kworker.0 Request processed in 350us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864759.581831:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1787864759.581848:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787864759.581854:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844850560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581883:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844850560:12345-0@lo:400:kworker.0 Request processed in 30us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864759.581920:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787864759.581932:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787864759.581938:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844850176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.581968:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844850176:12345-0@lo:400:kworker.0 Request processed in 30us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864759.582056:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787864759.582077:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787864759.582082:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448116d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844850048:12345-0@lo:400:kworker.0 Request processed in 384us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864759.582089:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844850688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864759.582096:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787864759.582125:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844850688:12345-0@lo:400:kworker.0 Request processed in 40us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864759.582131:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787864759.582294:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864759.582306:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844849408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864759.582324:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864759.582373:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844849408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.582379:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864759.582408:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849920 00000100:00100000:3.0:1787864759.582413:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849920 00000100:00100000:3.0:1787864759.582454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844849664 00000100:00100000:3.0:1787864759.582457:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844849664 00000100:00100000:3.0:1787864759.582486:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864759.582494:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844849920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.582542:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844849920:12345-0@lo:400:kworker.0 Request processed in 46us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.582549:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864759.582569:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864759.582575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844849664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.582672:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844849664:0@lo:400:kworker.0 00010000:00080000:0.0:1787864759.582690:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90780 x1874711844850176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864759.582771:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844850176:0@lo:400:kworker.0 00010000:00080000:0.0:1787864759.582789:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c921c0 x1874711844850688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864759.582838:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844850688:0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.582856:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844849536:0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.582869:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844850048:0@lo:400:kworker.0 00000100:00100000:0.0:1787864759.582881:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844850560:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.583516:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844849664:12345-0@lo:400:kworker.0 Request processed in 44us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864759.583529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1787864759.583532:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864759.583538:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864759.583542:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864759.583544:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864759.585259:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbdd680 x1874711844849408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864759.585304:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844849408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864759.585327:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844849920:0@lo:400:kworker.0 00010000:00080000:3.0:1787864759.585340:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90b40 x1874711844850432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864759.585349:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850432:0@lo:400:kworker.0 00010000:00080000:3.0:1787864759.585362:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448114b40 x1874711844850816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864759.585371:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850816:0@lo:400:kworker.0 00010000:00080000:3.0:1787864759.585383:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c903c0 x1874711844850304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864759.585393:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844850304:0@lo:400:kworker.0 00000100:00100000:3.0:1787864759.585406:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844849280:0@lo:400:kworker.0 00010000:00010000:3.0:1787864759.641164:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864760.602481:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864760.602516:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864760.602620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864760.602671:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844850944 00000100:00100000:0.0:1787864760.602682:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844850944 00000100:00100000:0.0:1787864760.602751:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787864760.602763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864760.602971:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864760.603055:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844850944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 293us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864760.603071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787864760.603503:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844850944:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864760.665573:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864761.113580:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844851072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864761.113647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864761.114099:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851072 00000100:00100000:3.0:1787864761.114114:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851072 00000100:00100000:3.0:1787864761.114198:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864761.114215:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844851072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864761.114273:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787864761.114822:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864761.114846:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844851200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864761.114922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864761.114999:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851200 00000100:00100000:2.0:1787864761.115005:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851200 00000100:00100000:2.0:1787864761.115048:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787864761.115057:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844851200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864761.115078:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864761.115120:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844851200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864761.115126:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1787864761.115143:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787864761.115173:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448114b40 x1874711844851200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864761.115196:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448114b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844851200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864761.117863:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844851072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3642us (4201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864761.117884:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1787864761.118802:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcbe1c0 x1874711844851072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864761.118830:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844851072:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787864761.692228:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864761.952982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953055:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953104:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953186:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864761.953222:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899648 00000100:00100000:1.0:1787864761.953232:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899648 00000100:00100000:1.0:1787864761.953289:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 333 00000100:00100000:1.0:1787864761.953301:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825899648:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.953389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825899648:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.953398:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 333 00000100:00100000:1.0:1787864761.953438:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899904 00000100:00100000:1.0:1787864761.953454:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899904 00000100:00100000:1.0:1787864761.953496:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900160 00000100:00100000:1.0:1787864761.953499:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900160 00000100:00100000:1.0:1787864761.953515:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825899776 00000100:00100000:1.0:1787864761.953517:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825899776 00000100:00100000:1.0:1787864761.953530:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900288 00000100:00100000:1.0:1787864761.953532:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900288 00000100:00100000:1.0:1787864761.953564:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:1.0:1787864761.953572:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825899904:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.953808:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825899904:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 236us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.953815:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:1.0:1787864761.953829:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:1.0:1787864761.953836:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825900160:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.953865:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825900160:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.953872:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:1.0:1787864761.953885:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:1.0:1787864761.953910:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+18:2409:x1874711825899776:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.953942:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+18:2409:x1874711825899776:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.953949:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:1.0:1787864761.953964:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:1.0:1787864761.953970:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825900288:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.954009:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825900288:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 39us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.954024:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:1.0:1787864761.954057:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900032 00000100:00100000:1.0:1787864761.954062:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900032 00000100:00100000:1.0:1787864761.954094:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:1.0:1787864761.954101:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825900032:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864761.954132:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825900032:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 30us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864761.954138:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00080000:1.0:1787864761.954278:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864761.954284:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864761.954286:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864762.143862:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864762.143955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864762.144064:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851328 00000100:00100000:1.0:1787864762.144072:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851328 00000100:00100000:1.0:1787864762.144124:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787864762.144132:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844851328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864762.144174:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787864762.157810:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844851328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13668us (13844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864762.157825:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787864762.158271:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844851328:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1787864762.274409:0:13669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787864762.715938:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787864763.234856:0:13717:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd9471e70 20000000:00000080:3.0:1787864763.234872:0:13717:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92744821d400 uarg=0000000000000000 20000000:01000000:3.0:1787864763.236107:0:13717:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787864763.236116:0:13717:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787864763.236122:0:13717:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787864763.236592:0:13718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787864763.236752:0:13717:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787864763.243720:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787864763.243753:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787864763.243767:0:13717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787864763.243781:0:13717:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864763.243798:0:13717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243815:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243823:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243830:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243834:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243852:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243857:0:13717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.243861:0:13717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244008:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244021:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244035:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851456:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864763.244183:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244192:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244200:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851584:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864763.244237:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244246:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 23 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244266:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851712:0@lo:104: 00000100:00100000:3.0:1787864763.244308:0:13717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864763.244352:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244360:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 23 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244368:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851840:0@lo:104: 00010000:00010000:3.0:1787864763.244392:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 23 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244399:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 23 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244406:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851968:0@lo:104: 00010000:00010000:3.0:1787864763.244426:0:13717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.244432:0:13717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 23 pid: 6504 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244439:0:13717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844852096:0@lo:104: 00000100:00100000:3.0:1787864763.244454:0:13717:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757642cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864763.244472:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787864763.244490:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864763.244517:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864763.244527:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864763.244536:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851712 00000100:00100000:1.0:1787864763.244541:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851712 00000100:00100000:1.0:1787864763.244574:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851840 00000100:00100000:1.0:1787864763.244583:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851840 00000100:00100000:1.0:1787864763.244597:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844851968 00000100:00100000:1.0:1787864763.244599:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844851968 00000100:00100000:1.0:1787864763.244608:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852096 00000100:00100000:1.0:1787864763.244609:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852096 00000100:00100000:1.0:1787864763.244620:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787864763.244628:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744811ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:13717:x1874711844851712:12345-0@lo:104: 00010000:00010000:1.0:1787864763.244639:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.244688:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864763.244694:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744811ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+6:13717:x1874711844851712:12345-0@lo:104: Request processed in 67us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.244701:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787864763.244738:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864763.244744:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:13717:x1874711844851840:12345-0@lo:104: 00010000:00010000:1.0:1787864763.244752:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.244783:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864763.244788:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+5:13717:x1874711844851840:12345-0@lo:104: Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.244793:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864763.244805:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864763.244809:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787864763.244811:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:13717:x1874711844851968:12345-0@lo:104: 00000100:00100000:3.0:1787864763.244815:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1787864763.244817:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.244853:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851712:0@lo:104: 00010000:00010000:1.0:1787864763.245881:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787864763.245917:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc861c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+4:13717:x1874711844851968:12345-0@lo:104: Request processed in 1105us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.245927:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787864763.245951:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787864763.245959:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:13717:x1874711844852096:12345-0@lo:104: 00010000:00010000:1.0:1787864763.245980:0:6495:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246025:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787864763.246030:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+3:13717:x1874711844852096:12345-0@lo:104: Request processed in 74us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.246036:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1787864763.246053:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787864763.246058:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246066:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864763.246070:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246078:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864763.246086:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864763.246092:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864763.246124:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246143:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864763.246166:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246172:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db31200/0x2fcb8c294dc433f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433fb expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246184:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787864763.246187:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246193:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864763.246195:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246202:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864763.246209:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864763.246215:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864763.246228:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246234:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864763.246249:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246256:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949200/0x2fcb8c294dc433e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433ed expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246270:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864763.246273:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246279:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864763.246282:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246288:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864763.246294:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864763.246299:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864763.246313:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246318:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864763.246324:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246330:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db30200/0x2fcb8c294dc433d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433df expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246338:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864763.246340:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246355:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864763.246358:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246364:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864763.246370:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864763.246376:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787864763.246389:0:10329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246394:0:10329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864763.246401:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246407:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db30800/0x2fcb8c294dc433ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc433d1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246419:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864763.246420:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864763.246422:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864763.246429:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864763.246435:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864763.246441:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864763.246460:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844852224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.246497:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864763.246524:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.246539:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864763.246547:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844852608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864763.246562:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864763.246581:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864763.246586:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864763.246617:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852224 00000100:00100000:1.0:1787864763.246622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852224 00010000:00010000:1.0:1787864763.246643:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 24 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864763.246659:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852352 00000100:00100000:1.0:1787864763.246661:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852352 00010000:00010000:1.0:1787864763.246675:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 25 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864763.246685:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852608 00000100:00100000:1.0:1787864763.246687:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852608 00010000:00010000:1.0:1787864763.246697:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 26 pid: 6504 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864763.246708:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864763.246714:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3640:x1874711844852224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864763.246724:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864763.246729:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 26 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246738:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 26 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246752:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30000/0x2fcb8c294dc433fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc433f4 expref: 26 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246763:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864763.246798:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3640:x1874711844852224:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.246805:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864763.246818:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864763.246825:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844852352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864763.246832:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864763.246836:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 24 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246843:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 24 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246852:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864763.246871:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844852352:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.246876:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864763.246905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787864763.246911:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3640:x1874711844852608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864763.246919:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864763.246923:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 23 pid: 6504 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246931:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 23 pid: 6504 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.246940:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864763.246954:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.246963:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3640:x1874711844852608:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.246981:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864763.246999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864763.247030:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31400/0x2fcb8c294dc433ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc433e6 expref: 22 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864763.247043:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864763.247049:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851840:0@lo:104: 00000100:00100000:1.0:1787864763.247073:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852480 00000100:00100000:1.0:1787864763.247077:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852480 00010000:00010000:1.0:1787864763.247092:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 22 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864763.247106:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787864763.247108:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851968:0@lo:104: 00000100:00100000:1.0:1787864763.247112:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3637:x1874711844852480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864763.247116:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949000/0x2fcb8c294dc433d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc433ca expref: 22 pid: 6504 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.247119:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864763.247123:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 21 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.247125:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844852096:0@lo:104: 00010000:00010000:1.0:1787864763.247131:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 21 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.247142:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc433df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc433d8 expref: 21 pid: 6503 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864763.247152:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864763.247181:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844852608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.247187:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3637:x1874711844852480:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864763.247195:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864763.247204:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844852224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.247226:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864763.251178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864763.251295:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900416 00000100:00100000:0.0:1787864763.251309:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900416 00010000:00010000:0.0:1787864763.251357:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 13 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864763.251405:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:0.0:1787864763.251430:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825900416:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864763.251444:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864763.251451:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 13 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864763.251463:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 13 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864763.251484:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864763.251588:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825900416:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 159us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864763.251596:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00010000:00010000:3.0:1787864763.257664:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949e00/0x2fcb8c294dc43409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c9 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864763.257693:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851456:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864763.257712:0:13717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13717:1874711844851584:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864763.257759:0:13717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864763.265942:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864763.266069:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900544 00000100:00100000:2.0:1787864763.266098:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900544 00010000:00010000:2.0:1787864763.266157:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864763.266444:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:2.0:1787864763.266456:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:2409:x1874711825900544:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864763.266485:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864763.266493:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266509:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266531:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797000/0x2fcb8c294dc43402 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac8c2 expref: 12 pid: 6504 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266549:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266558:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266577:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266584:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266591:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266610:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266617:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864763.266622:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266631:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266655:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.266668:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864763.266740:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2409:x1874711825900544:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 286us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864763.266748:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00010000:00010000:3.0:1787864763.267215:0:13717:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.267228:0:13717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.267235:0:13717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4353d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864763.682764:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1787864763.682786:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1787864763.682935:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683028:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683038:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683045:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864763.683050:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683093:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683113:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1347dc18 (ffff927554cab100) 00010000:00010000:2.0:1787864763.683116:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864763.683123:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683130:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43495 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683149:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683155:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683161:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683166:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864763.683169:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683175:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683183:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff927447234d00) 00010000:00010000:2.0:1787864763.683186:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864763.683189:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683205:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc434aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683226:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683232:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683238:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683244:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864763.683247:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683253:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683266:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1347dc18 (ffff927554cab100) 00010000:00010000:2.0:1787864763.683268:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864763.683271:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683277:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796200/0x2fcb8c294dc43513 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x1347dc18 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683290:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683296:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683308:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683313:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864763.683318:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683324:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683333:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff927543a2e900) 00010000:00010000:2.0:1787864763.683336:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864763.683339:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.683345:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc4352f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864763.683658:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844852736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787864763.683731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864763.684082:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852736 00000100:00100000:3.0:1787864763.684096:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852736 00000100:00080000:2.0:1787864763.684377:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864763.685450:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864763.685475:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844852736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787864763.685523:0:8423:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1787864763.685584:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a90a6b6, atime: 0x6a90a6b6, ctime: 0x6a90a6b6, blocks: 0x0 00010000:00010000:3.0:1787864763.685593:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.685613:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:3.0:1787864763.685618:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864763.685625:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.685647:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.685658:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.685667:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864763.685693:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864763.685953:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844852736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 489us (2223us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1787864763.686088:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864763.686096:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.686106:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864763.686111:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.686135:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.686156:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.686164:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dea6dff/0x2fcb8c294dc43544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864763.686185:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864763.686187:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864763.686189:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787864763.686249:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92757dbde1c0/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787864763.686258:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844852736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787864763.688317:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787864763.737365:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787864764.144448:0:13767:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff105a55f0 20000000:00000080:0.0:1787864764.144470:0:13767:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff927447110800 uarg=0000000000000000 20000000:01000000:0.0:1787864764.144633:0:13767:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787864764.144641:0:13767:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1787864764.144647:0:13767:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1787864764.146781:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1787864764.147148:0:13767:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787864764.147352:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787864764.147387:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787864764.147403:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787864764.147415:0:13767:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787864764.147442:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147461:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147492:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147499:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147573:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147583:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147590:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864764.147595:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147606:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147623:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147633:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.147639:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30000/0x2fcb8c294dc4354b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.699495:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852864:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.699595:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844853120:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.699597:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.699833:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844852992:0@lo:400:kworker.0 00000100:00100000:0.0:1787864764.699993:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852864 00000100:00100000:0.0:1787864764.700002:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852864 00000100:00100000:0.0:1787864764.700081:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787864764.700092:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3637:x1874711844852864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705557:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844853632:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705611:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705637:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844854144:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705699:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844854656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864764.705727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705768:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787864764.705776:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844853248:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705800:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705821:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844853760:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.705864:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844854272:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.705884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.706101:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853632 00000100:00100000:3.0:1787864764.706111:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853632 00000100:00100000:3.0:1787864764.706179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854144 00000100:00100000:3.0:1787864764.706182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854144 00000100:00100000:3.0:1787864764.706203:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853248 00000100:00100000:3.0:1787864764.706205:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853248 00000100:00100000:3.0:1787864764.706221:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787864764.706241:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844853632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706310:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844853632:12345-0@lo:400:kworker.0 Request processed in 80us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.706319:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787864764.706338:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787864764.706344:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844854144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706388:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844854144:12345-0@lo:400:kworker.0 Request processed in 44us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.706395:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787864764.706406:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787864764.706412:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844853248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706438:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844853248:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.706445:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787864764.706467:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853760 00000100:00100000:3.0:1787864764.706471:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853760 00000100:00100000:3.0:1787864764.706498:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854272 00000100:00100000:3.0:1787864764.706501:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854272 00000100:00100000:3.0:1787864764.706521:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864764.706527:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844853760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706559:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844853760:12345-0@lo:400:kworker.0 Request processed in 32us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.706566:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787864764.706576:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787864764.706582:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844854272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706608:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844854272:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.706614:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787864764.706633:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864764.706639:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864764.706641:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864764.706701:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844853248:0@lo:400:kworker.0 00010000:00080000:3.0:1787864764.706726:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c4f00 x1874711844853760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864764.706736:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844853760:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706749:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844854272:0@lo:400:kworker.0 00010000:00080000:3.0:1787864764.706760:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90780 x1874711844853632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864764.706769:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844853632:0@lo:400:kworker.0 00010000:00080000:3.0:1787864764.706778:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c6d00 x1874711844854144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864764.706787:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844854144:0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.706845:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854656 00000100:00100000:3.0:1787864764.706849:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854656 00000100:00100000:3.0:1787864764.706876:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864764.706883:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844854656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787864764.706934:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864764.706997:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844854656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.707004:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864764.707054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844854656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864764.707106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853120 00000100:00100000:3.0:1787864764.707109:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853120 00000100:00100000:3.0:1787864764.707137:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787864764.707143:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844853120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.707193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844853120:12345-0@lo:400:kworker.0 Request processed in 49us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.707200:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787864764.707239:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844853120:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.709325:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844853376:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.709410:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.709464:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.709495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.709522:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844854400:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.709544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.709600:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853376 00000100:00100000:1.0:1787864764.709679:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853376 00000100:00100000:1.0:1787864764.709740:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787864764.709749:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844853376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.709818:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844853376:12345-0@lo:400:kworker.0 Request processed in 69us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.709826:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787864764.709854:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853888 00000100:00100000:1.0:1787864764.709857:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853888 00000100:00100000:1.0:1787864764.709914:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854400 00000100:00100000:1.0:1787864764.709918:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854400 00000100:00100000:3.0:1787864764.710801:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787864764.710820:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844853888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.710917:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844853888:12345-0@lo:400:kworker.0 Request processed in 105us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.710925:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787864764.710969:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864764.711189:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864764.711199:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.711239:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844854400:12345-0@lo:400:kworker.0 Request processed in 43us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.711245:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787864764.711293:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844853376:0@lo:400:kworker.0 00010000:00080000:1.0:1787864764.711309:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274472c4000 x1874711844853888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864764.713540:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844853888:0@lo:400:kworker.0 00000100:00100000:1.0:1787864764.713604:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844854400:0@lo:400:kworker.0 00000100:00100000:2.0:1787864764.715133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.715559:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844853504:0@lo:400:kworker.0 00000100:00100000:2.0:1787864764.715617:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864764.718746:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3637:x1874711844852864:12345-0@lo:400:kworker.0 Request processed in 18642us (19134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.718766:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787864764.719133:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844852864:0@lo:400:kworker.0 00000100:00100000:2.0:1787864764.719469:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844854016:0@lo:400:kworker.0 00000100:00100000:2.0:1787864764.719524:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.724945:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844852992 00000100:00100000:3.0:1787864764.724973:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844852992 00000100:00100000:3.0:1787864764.725088:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844853504 00000100:00100000:3.0:1787864764.725092:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844853504 00000100:00100000:3.0:1787864764.725139:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787864764.725151:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844852992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864764.725369:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787864764.725381:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844853504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864764.725716:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844853504:12345-0@lo:400:kworker.0 Request processed in 337us (10097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.725726:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:0.0:1787864764.725785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864764.729545:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844852992:12345-0@lo:400:kworker.0 Request processed in 4375us (14399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.729572:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787864764.729875:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844854528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864764.730155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.730238:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844852992:0@lo:400:kworker.0 00000100:00100000:2.0:1787864764.730278:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844853504:0@lo:400:kworker.0 00000100:00100000:0.0:1787864764.730611:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854528 00000100:00100000:0.0:1787864764.730620:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854528 00000100:00100000:0.0:1787864764.730687:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787864764.730698:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844854528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864764.730732:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864764.732328:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844854528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1618us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.732345:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787864764.732616:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854016 00000100:00100000:3.0:1787864764.732628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854016 00000100:00100000:3.0:1787864764.732718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787864764.732729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844854016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864764.732969:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844854016:12345-0@lo:400:kworker.0 Request processed in 232us (13435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.732976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1787864764.733650:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864764.733770:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844854528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864764.734154:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844854016:0@lo:400:kworker.0 00010000:00010000:1.0:1787864764.761510:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787864764.889384:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864764.889395:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757de48800 from 7 10000000:01000000:1.0:1787864764.889402:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864764.889470:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.889484:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.889499:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.889531:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844854784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.889630:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.889704:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.889804:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854784 00000100:00100000:2.0:1787864764.889813:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854784 00000100:00100000:2.0:1787864764.889877:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1787864764.889912:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:6508:x1874711844854784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864764.889940:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864764.889967:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797200/0x2fcb8c294dc43559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43552 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.889994:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797200/0x2fcb8c294dc43559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43552 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.890007:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797200/0x2fcb8c294dc43559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43552 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.890018:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797200, rc 0) 00000100:00100000:2.0:1787864764.890073:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844854784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864764.890080:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1787864764.890373:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844854784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864764.890389:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.890399:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.890474:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844854912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.890505:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.890595:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864764.894199:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844854912 00000100:00100000:0.0:1787864764.894220:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844854912 00000100:00100000:0.0:1787864764.894389:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1787864764.894402:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844854912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864764.894654:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844854912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.894685:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1787864764.894800:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844854912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.894869:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.896831:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.896922:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.897397:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855040 00000100:00100000:2.0:1787864764.897409:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855040 00000100:00100000:2.0:1787864764.897483:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1787864764.897495:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844855040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.897703:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844855040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864764.897712:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1787864764.898535:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.902790:0:13780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13780:1874711844855168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.903059:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.903267:0:13780:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.905336:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855168 00000100:00100000:2.0:1787864764.905376:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855168 00000100:00100000:2.0:1787864764.905466:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1787864764.905479:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:13780:x1874711844855168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864764.906025:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:13780:x1874711844855168:12345-0@lo:502:llog_process_th.0 Request processed in 546us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864764.906035:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1787864764.906265:0:13780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13780:1874711844855168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864764.906321:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864764.906334:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.906336:0:13780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864764.906343:0:13780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92757de48800 00000020:00000080:1.0:1787864764.906346:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864764.906426:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864764.906429:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.906430:0:13780:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864764.906433:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864764.906435:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.906437:0:13780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787864764.906440:0:13780:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92757de48800 00000020:00000080:1.0:1787864764.906442:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864764.906493:0:13780:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13780:1874711844855296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.906562:0:13780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.906612:0:13780:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.906777:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855296 00000100:00100000:2.0:1787864764.906783:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855296 00000100:00100000:2.0:1787864764.906836:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1787864764.906847:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:13780:x1874711844855296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864764.907010:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:13780:x1874711844855296:12345-0@lo:502:llog_process_th.0 Request processed in 165us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864764.907019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787864764.907849:0:13780:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13780:1874711844855296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864764.907938:0:13780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864764.907947:0:13780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.907950:0:13780:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787864764.907954:0:13780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787864764.908729:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787864764.908761:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864764.908775:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.908789:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864764.908802:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787864764.908805:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92757bdea800 from 7 10000000:01000000:2.0:1787864764.908808:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864764.909111:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.909122:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.909303:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864764.909337:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.909422:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.909481:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864764.909481:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855424 00000100:00100000:0.0:1787864764.909490:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855424 00000100:00100000:0.0:1787864764.909573:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1787864764.909584:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+21:6508:x1874711844855424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864764.909601:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864764.909617:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db30000/0x2fcb8c294dc43567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc43560 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.909645:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db30000/0x2fcb8c294dc43567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc43560 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.909658:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db30000/0x2fcb8c294dc43567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc43560 expref: 22 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.909669:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30000, rc 0) 00000100:00100000:0.0:1787864764.909731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844855424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.909738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787864764.911647:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864764.911682:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.911695:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.911813:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.911915:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.911972:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.912002:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855552 00000100:00100000:1.0:1787864764.912009:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855552 00000100:00100000:1.0:1787864764.912068:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787864764.912080:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844855552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.912669:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844855552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 589us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.912679:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787864764.912746:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.912789:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.912847:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.912864:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.912878:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855680 00000100:00100000:1.0:1787864764.912930:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855680 00000100:00100000:1.0:1787864764.912972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787864764.912979:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844855680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.913071:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844855680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.913078:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787864764.913659:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844855680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.916438:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13782:1874711844855808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864764.917742:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.917818:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71780 going to sleep for 11 seconds 00000100:00100000:3.0:1787864764.917964:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855808 00000100:00100000:3.0:1787864764.917975:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855808 00000100:00100000:3.0:1787864764.918040:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1787864764.918053:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:13782:x1874711844855808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864764.918223:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:13782:x1874711844855808:12345-0@lo:502:llog_process_th.0 Request processed in 171us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.918232:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1787864764.919369:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13782:1874711844855808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864764.919427:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864764.919444:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864764.919447:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787864764.919461:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92757bdea800 00000020:00000080:2.0:1787864764.919465:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864764.919558:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864764.919563:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864764.919564:0:13782:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787864764.919568:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864764.919571:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864764.919572:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787864764.919576:0:13782:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92757bdea800 00000020:00000080:2.0:1787864764.919579:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787864764.919640:0:13782:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13782:1874711844855936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864764.919723:0:13782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.919773:0:13782:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.919931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844855936 00000100:00100000:1.0:1787864764.919939:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844855936 00000100:00100000:1.0:1787864764.920006:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1787864764.920017:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:13782:x1874711844855936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.920148:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:13782:x1874711844855936:12345-0@lo:502:llog_process_th.0 Request processed in 132us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.920156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1787864764.921974:0:13782:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13782:1874711844855936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787864764.922031:0:13782:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864764.922041:0:13782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864764.922043:0:13782:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787864764.922052:0:13782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787864764.923251:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787864764.923293:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864764.924037:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.924050:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864764.924062:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864764.924065:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927547df8000 from 7 10000000:01000000:1.0:1787864764.924068:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864764.924122:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.924154:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.924167:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.924204:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.924292:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.924350:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.925137:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856064 00000100:00100000:2.0:1787864764.925149:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856064 00000100:00100000:2.0:1787864764.925218:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1787864764.925230:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:6508:x1874711844856064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864764.925250:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864764.925269:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4356e expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.925314:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4356e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.925328:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4356e expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.925338:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:2.0:1787864764.925413:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864764.925420:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1787864764.933494:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864764.933646:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864764.933662:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864764.933771:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864764.933861:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.934088:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856192 00000100:00100000:1.0:1787864764.934096:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856192 00000100:00100000:1.0:1787864764.934155:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787864764.934165:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.935657:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1483us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.935672:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1787864764.936447:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756de3bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864764.936486:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.936634:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.936705:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864764.936741:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864764.937098:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856320 00000100:00100000:0.0:1787864764.937107:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856320 00000100:00100000:0.0:1787864764.938434:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1787864764.938455:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864764.938658:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.938667:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1787864764.938803:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864764.939113:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13784:1874711844856448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864764.939161:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.947329:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856448 00000100:00100000:1.0:1787864764.947348:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856448 00000100:00100000:1.0:1787864764.947409:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787864764.947419:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:13784:x1874711844856448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.947799:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:13784:x1874711844856448:12345-0@lo:502:llog_process_th.0 Request processed in 378us (8634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.947809:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000040:00080000:3.0:1787864764.948060:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787864764.948178:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b71600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864764.948211:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbe1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13784:1874711844856448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787864764.948252:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864764.948265:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864764.948269:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787864764.948276:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927547df8000 00000020:00000080:3.0:1787864764.948279:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864764.948423:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864764.948428:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864764.948430:0:13784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787864764.948432:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864764.948435:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864764.948436:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787864764.948440:0:13784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927547df8000 00000020:00000080:3.0:1787864764.948442:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787864764.949231:0:13784:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13784:1874711844856576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864764.949393:0:13784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.949443:0:13784:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864764.949658:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856576 00000100:00100000:0.0:1787864764.949667:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856576 00000100:00100000:0.0:1787864764.949717:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787864764.949727:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:13784:x1874711844856576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864764.950523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:13784:x1874711844856576:12345-0@lo:502:llog_process_th.0 Request processed in 781us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864764.950536:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787864764.956569:0:13784:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13784:1874711844856576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787864764.956935:0:13784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864764.956975:0:13784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864764.956979:0:13784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787864764.956986:0:13784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787864764.957180:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787864764.957265:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864764.957279:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864764.957292:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864764.957305:0:6508:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787864764.957308:0:6508:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff927548600000 from 7 10000000:01000000:3.0:1787864764.957311:0:6508:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864764.957356:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864764.957365:0:6508:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864764.957377:0:6508:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864764.957404:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864764.958125:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.958208:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.958428:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856704 00000100:00100000:1.0:1787864764.958437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856704 00000100:00100000:1.0:1787864764.958522:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787864764.958541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:6508:x1874711844856704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864764.958561:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864764.958580:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4357c expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.958609:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4357c expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.958622:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4357c expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.958632:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949200, rc 0) 00000100:00100000:1.0:1787864764.958693:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844856704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.958702:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787864764.958758:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864764.958777:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864764.958787:0:6508:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864764.958873:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.958937:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.958969:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.958983:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856832 00000100:00100000:1.0:1787864764.958987:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856832 00000100:00100000:1.0:1787864764.959011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787864764.959023:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844856832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.959142:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844856832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.959150:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787864764.959180:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.959211:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.959253:0:6508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.959267:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd75780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.959277:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844856960 00000100:00100000:1.0:1787864764.959281:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844856960 00000100:00100000:1.0:1787864764.959310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787864764.959317:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844856960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864764.959394:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756deff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:6508:x1874711844856960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.959400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787864764.959439:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:6508:1874711844856960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864764.962646:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13786:1874711844857088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864764.962769:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864764.962834:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3000 going to sleep for 11 seconds 00000100:00100000:1.0:1787864764.963015:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857088 00000100:00100000:1.0:1787864764.963024:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857088 00000100:00100000:1.0:1787864764.963084:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787864764.963095:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:13786:x1874711844857088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.963248:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:13786:x1874711844857088:12345-0@lo:502:llog_process_th.0 Request processed in 154us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864764.963257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787864764.963441:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13786:1874711844857088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864764.963493:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864764.963505:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.963626:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864764.963637:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927548600000 00000020:00000080:1.0:1787864764.963640:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864764.972121:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864764.972455:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.972459:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864764.972464:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864764.972469:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864764.972470:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787864764.972488:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff927548600000 00000020:00000080:1.0:1787864764.972491:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864764.972730:0:13786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13786:1874711844857216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864764.972841:0:13786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864764.973003:0:13786:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757642c9c0 going to sleep for 11 seconds 00000040:00080000:1.0:1787864764.975917:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787864764.976661:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857216 00000100:00100000:3.0:1787864764.976689:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857216 00000100:00100000:3.0:1787864764.976760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1787864764.976770:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:13786:x1874711844857216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864764.977139:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:13786:x1874711844857216:12345-0@lo:502:llog_process_th.0 Request processed in 370us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864764.977148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1787864764.977438:0:13786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:13786:1874711844857216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864764.977609:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864764.977620:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864764.977623:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787864764.977628:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787864764.978303:0:6508:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787864764.978334:0:6508:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864764.978346:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864764.978360:0:6508:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864765.213986:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864765.214066:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900672 00000100:00100000:0.0:1787864765.214144:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900672 00000100:00100000:0.0:1787864765.214267:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 355 00000100:00100000:0.0:1787864765.214278:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:6199:x1874711825900672:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864765.214300:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864765.214320:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31200/0x2fcb8c294dc4358a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac916 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.215353:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31200/0x2fcb8c294dc4358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac916 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.215427:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31200/0x2fcb8c294dc4358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac916 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.215446:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31200, rc 0) 00000100:00100000:0.0:1787864765.215735:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825900672:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 1442us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864765.215746:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 355 00000100:00100000:1.0:1787864765.222042:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864765.222520:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900800 00000100:00100000:3.0:1787864765.222533:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900800 00000100:00100000:3.0:1787864765.222603:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 356 00000100:00100000:3.0:1787864765.222614:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825900800:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864765.222808:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825900800:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 195us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864765.222817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 356 00000100:00100000:2.0:1787864765.228142:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864765.231005:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825900928 00000100:00100000:0.0:1787864765.231026:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825900928 00000100:00100000:0.0:1787864765.231132:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 357 00000100:00100000:0.0:1787864765.231144:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825900928:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864765.231354:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825900928:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 212us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864765.231363:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 357 00000100:00100000:0.0:1787864765.236066:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864765.237727:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901056 00000100:00100000:1.0:1787864765.237745:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901056 00000100:00100000:1.0:1787864765.237834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 358 00000100:00100000:1.0:1787864765.237846:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:10803:x1874711825901056:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787864765.238100:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:10803:x1874711825901056:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 256us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864765.238109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 358 00000100:00100000:1.0:1787864765.247257:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864765.247516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901184 00000100:00100000:3.0:1787864765.247528:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901184 00000100:00100000:3.0:1787864765.247598:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 359 00000100:00100000:3.0:1787864765.247609:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:10803:x1874711825901184:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864765.247799:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:10803:x1874711825901184:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 192us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864765.247808:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 359 00000100:00100000:2.0:1787864765.251141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864765.251248:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901312 00000100:00100000:0.0:1787864765.251261:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901312 00000100:00100000:0.0:1787864765.251331:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 360 00000100:00100000:0.0:1787864765.251342:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:6199:x1874711825901312:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864765.251362:0:6503:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864765.251385:0:6503:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757db31000/0x2fcb8c294dc43591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac91d expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.251441:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757db31000/0x2fcb8c294dc43591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac91d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.251453:0:6503:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757db31000/0x2fcb8c294dc43591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac91d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864765.251463:0:6503:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31000, rc 0) 00000100:00100000:0.0:1787864765.253363:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825901312:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 2007us (2227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864765.253378:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 360 00000100:00100000:0.0:1787864765.263203:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864765.263349:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901440 00000100:00100000:1.0:1787864765.263379:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901440 00000100:00100000:1.0:1787864765.263450:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 361 00000100:00100000:1.0:1787864765.263460:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825901440:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864765.263648:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825901440:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 189us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864765.263657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 361 00000100:00100000:1.0:1787864765.268747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864765.268853:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901568 00000100:00100000:0.0:1787864765.268865:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901568 00000100:00100000:0.0:1787864765.268972:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 362 00000100:00100000:0.0:1787864765.268984:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825901568:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864765.269326:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:6199:x1874711825901568:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 342us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864765.269335:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 362 00000100:00100000:2.0:1787864765.277246:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864765.277343:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901696 00000100:00100000:3.0:1787864765.277354:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901696 00000100:00100000:3.0:1787864765.277423:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 363 00000100:00100000:3.0:1787864765.277434:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:10807:x1874711825901696:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864765.277628:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:10807:x1874711825901696:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 195us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864765.277646:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 363 00000100:00100000:3.0:1787864765.281577:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864765.283414:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901824 00000100:00100000:0.0:1787864765.283433:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901824 00000100:00100000:0.0:1787864765.283972:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 364 00000100:00100000:0.0:1787864765.283994:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:10807:x1874711825901824:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864765.284206:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:10807:x1874711825901824:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 223us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864765.284217:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 364 00000100:00100000:2.0:1787864765.721323:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844857344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864765.721428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864765.721737:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857344 00000100:00100000:1.0:1787864765.721746:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857344 00000100:00100000:1.0:1787864765.721811:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787864765.721821:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844857344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864765.721872:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864765.721978:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844857344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864765.721986:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864765.722418:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844857344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864765.786589:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864765.977680:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787864765.979391:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787864766.233439:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864766.233470:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844857472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864766.233560:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864766.234978:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857472 00000100:00100000:0.0:1787864766.234994:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857472 00000100:00100000:2.0:1787864766.235213:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864766.235234:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844857600:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787864766.235261:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864766.235305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864766.235315:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787864766.235336:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844857472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864766.235375:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864766.235642:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844857472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 316us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864766.235651:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:3.0:1787864766.235739:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274489b9e00 x1874711844857472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864766.235776:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844857472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864766.239633:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857600 00000100:00100000:0.0:1787864766.239656:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857600 00000100:00080000:2.0:1787864766.239810:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864766.239997:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787864766.240014:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844857600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864766.240049:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864766.240198:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844857600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 190us (4894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864766.240207:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1787864766.240269:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc84780 x1874711844857600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864766.240382:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844857600:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787864766.809689:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864767.083514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864767.083572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864767.083607:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864767.083646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864767.083671:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864767.083718:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864767.083822:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902208 00000100:00100000:3.0:1787864767.083834:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902208 00000100:00100000:3.0:1787864767.083959:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902464 00000100:00100000:3.0:1787864767.083962:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902464 00000100:00100000:3.0:1787864767.083977:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902080 00000100:00100000:3.0:1787864767.083979:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902080 00000100:00100000:3.0:1787864767.083990:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902592 00000100:00100000:3.0:1787864767.083992:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902592 00000100:00100000:3.0:1787864767.084021:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 199 00000100:00100000:3.0:1787864767.084031:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902208:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864767.084132:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902208:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 103us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864767.084141:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 199 00000100:00100000:3.0:1787864767.084160:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:3.0:1787864767.084166:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825902464:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864767.084192:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825902464:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864767.084211:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:3.0:1787864767.084224:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 201 00000100:00100000:3.0:1787864767.084229:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902080:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864767.084256:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902080:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 27us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864767.084262:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 201 00000100:00100000:3.0:1787864767.084273:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:3.0:1787864767.084279:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825902592:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864767.084304:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825902592:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864767.084310:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:3.0:1787864767.084335:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902336 00000100:00100000:3.0:1787864767.084338:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902336 00000100:00100000:3.0:1787864767.084368:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:3.0:1787864767.084375:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902336:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864767.084404:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825902336:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864767.084411:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:1.0:1787864767.085048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825901952 00000100:00100000:1.0:1787864767.085057:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825901952 00000100:00100000:1.0:1787864767.085108:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 365 00000100:00100000:1.0:1787864767.085124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825901952:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864767.085180:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825901952:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 58us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864767.085187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 365 00000100:00080000:0.0:1787864767.085611:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864767.085617:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864767.085620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864767.258405:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844857728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864767.258498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864767.258670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857728 00000100:00100000:1.0:1787864767.258680:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857728 00000100:00100000:1.0:1787864767.258750:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787864767.258760:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844857728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864767.258805:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787864767.263348:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844857728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4574us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864767.263367:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787864767.265561:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844857728:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864767.833170:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864768.857708:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864769.817593:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844857984:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817681:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817733:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844858496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817777:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844859008:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817798:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817826:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787864769.817831:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844858112:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817854:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817867:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844858624:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817913:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817927:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844859136:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.817958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864769.817986:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857984 00000100:00100000:2.0:1787864769.817993:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857984 00000100:00100000:2.0:1787864769.818033:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858496 00000100:00100000:2.0:1787864769.818036:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858496 00000100:00100000:2.0:1787864769.818060:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859008 00000100:00100000:2.0:1787864769.818063:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859008 00000100:00100000:2.0:1787864769.818076:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858624 00000100:00100000:2.0:1787864769.818078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858624 00000100:00100000:2.0:1787864769.818090:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859136 00000100:00100000:2.0:1787864769.818092:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859136 00000100:00100000:2.0:1787864769.818108:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787864769.818117:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844857984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818174:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558997840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844857984:12345-0@lo:400:kworker.0 Request processed in 57us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864769.818181:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1787864769.818206:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787864769.818228:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844858496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818264:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844858496:12345-0@lo:400:kworker.0 Request processed in 37us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864769.818270:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787864769.818282:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787864769.818288:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844859008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818412:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844859008:12345-0@lo:400:kworker.0 Request processed in 124us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864769.818418:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787864769.818430:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787864769.818436:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844858624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818466:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844858624:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864769.818471:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787864769.818480:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787864769.818486:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844859136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818511:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844859136:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864769.818517:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:2.0:1787864769.818561:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadbc00 x1874711844858624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864769.818577:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844858624:0@lo:400:kworker.0 00010000:00080000:2.0:1787864769.818588:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad92c0 x1874711844859136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864769.818610:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844859136:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818623:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844857984:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818631:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844858496:0@lo:400:kworker.0 00000100:00100000:2.0:1787864769.818639:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844859008:0@lo:400:kworker.0 00000100:00080000:2.0:1787864769.818691:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864769.818696:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864769.819487:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844858240:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819578:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844858752:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819627:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844859264:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819674:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1787864769.819682:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844857856:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819711:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819739:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844858368:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819783:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844858880:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819819:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819835:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844859392:0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.819854:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.819906:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858752 00000100:00100000:1.0:1787864769.819913:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858752 00000100:00100000:1.0:1787864769.820084:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859264 00000100:00100000:1.0:1787864769.820089:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859264 00000100:00100000:1.0:1787864769.820105:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858880 00000100:00100000:1.0:1787864769.820108:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858880 00000100:00100000:1.0:1787864769.820121:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859392 00000100:00100000:1.0:1787864769.820123:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859392 00000100:00100000:1.0:1787864769.820138:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864769.820145:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844858752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.820202:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844858752:12345-0@lo:400:kworker.0 Request processed in 57us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864769.820210:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864769.820227:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787864769.820233:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844859264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864769.820262:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844859264:12345-0@lo:400:kworker.0 Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864769.820268:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787864769.820279:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787864769.820284:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864769.820530:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844857856 00000100:00100000:0.0:1787864769.820535:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844857856 00000100:00100000:0.0:1787864769.820568:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787864769.820576:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844857856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864769.820614:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844857856:12345-0@lo:400:kworker.0 Request processed in 39us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864769.820628:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1787864769.820693:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844857856:0@lo:400:kworker.0 00010000:00080000:0.0:1787864769.820708:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada940 x1874711844858880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864769.820720:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844858880:0@lo:400:kworker.0 00010000:00080000:0.0:1787864769.820732:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fad83c0 x1874711844858752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864769.820741:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844858752:0@lo:400:kworker.0 00000100:00100000:0.0:1787864769.820752:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844859264:0@lo:400:kworker.0 00000100:00100000:0.0:1787864769.820789:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858240 00000100:00100000:0.0:1787864769.820792:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858240 00000100:00100000:0.0:1787864769.820819:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787864769.820826:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844858240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864769.820863:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844858240:12345-0@lo:400:kworker.0 Request processed in 38us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864769.820870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787864769.820919:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844858240:0@lo:400:kworker.0 00000100:00080000:2.0:1787864769.821529:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864769.821536:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864769.821742:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864769.821800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864769.822223:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844858880:12345-0@lo:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864769.822235:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787864769.822661:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864769.822679:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844859392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.822764:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844859392:12345-0@lo:400:kworker.0 Request processed in 94us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864769.822772:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787864769.822811:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858112 00000100:00100000:3.0:1787864769.822819:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858112 00000100:00100000:3.0:1787864769.822855:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844858368 00000100:00100000:3.0:1787864769.822859:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844858368 00000100:00100000:3.0:1787864769.822874:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787864769.822879:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844858112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.823025:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844858112:12345-0@lo:400:kworker.0 Request processed in 144us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864769.823032:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787864769.823045:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864769.823051:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844858368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.823083:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844858368:12345-0@lo:400:kworker.0 Request processed in 32us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864769.823088:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864769.823153:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844858368:0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.823168:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844859392:0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.823230:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844858112:0@lo:400:kworker.0 00000100:00100000:3.0:1787864769.823594:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864769.823638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864769.823808:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859520 00000100:00100000:0.0:1787864769.823821:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859520 00000100:00100000:0.0:1787864769.823940:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859648 00000100:00100000:0.0:1787864769.823945:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859648 00000100:00100000:0.0:1787864769.823966:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787864769.823974:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844859520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864769.824032:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864769.824075:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787864769.824088:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844859648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787864769.824107:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864769.824154:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844859648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864769.824162:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787864769.824211:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844859648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864769.824258:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844859520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864769.824268:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787864769.824471:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757db1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844859520:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787864769.828340:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1787864769.882676:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864770.841770:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844859776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864770.841868:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864770.843578:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859776 00000100:00100000:1.0:1787864770.843615:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859776 00000100:00100000:1.0:1787864770.843688:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787864770.843701:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844859776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787864770.843761:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787864770.843866:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844859776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 168us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864770.843875:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787864770.846120:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844859776:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864770.907785:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864771.353210:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864771.355058:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864771.355156:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864771.355310:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860032 00000100:00100000:2.0:1787864771.355321:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860032 00000100:00100000:2.0:1787864771.355401:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787864771.355413:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844860032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864771.355452:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787864771.355565:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864771.357856:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844859904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864771.357984:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864771.358156:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844859904 00000100:00100000:1.0:1787864771.358166:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844859904 00000100:00100000:1.0:1787864771.358245:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787864771.358256:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844859904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864771.358311:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864771.358363:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844859904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864771.358371:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787864771.358454:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787864771.358489:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274488483c0 x1874711844859904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864771.358513:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844859904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864771.363139:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844860032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7715us (7969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864771.363159:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1787864771.366756:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558aba940 x1874711844860032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864771.366794:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844860032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864771.929100:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864772.192030:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864772.192072:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864772.192150:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902848 00000100:00100000:2.0:1787864772.192166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902848 00000100:00100000:0.0:1787864772.192228:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864772.192279:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903360 00000100:00100000:0.0:1787864772.192287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864772.192288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903360 00000100:00100000:0.0:1787864772.192321:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864772.192350:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902976 00000100:00100000:2.0:1787864772.192357:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902976 00000100:00100000:0.0:1787864772.192359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864772.192388:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903232 00000100:00100000:2.0:1787864772.192393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903232 00000100:00100000:2.0:1787864772.192423:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 209 00000100:00100000:2.0:1787864772.192436:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825902848:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864772.192445:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 210 00000100:00100000:0.0:1787864772.192463:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825903360:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864772.194729:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825902848:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2279us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864772.194750:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 209 00000100:00100000:2.0:1787864772.194799:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 211 00000100:00100000:2.0:1787864772.194815:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825902976:12345-192.168.206.36@tcp:400:kworker.0 00000100:00080000:1.0:1787864772.194990:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864772.194997:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864772.195033:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 212 00000100:00100000:1.0:1787864772.195044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825903232:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864772.196228:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903104 00000100:00100000:3.0:1787864772.196244:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903104 00000100:00100000:3.0:1787864772.196551:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:3.0:1787864772.196562:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825903104:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864772.196828:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825903360:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 4369us (4598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864772.196851:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 210 00000100:00100000:0.0:1787864772.196914:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825902720 00000100:00100000:0.0:1787864772.196928:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825902720 00000100:00100000:0.0:1787864772.196957:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 367 00000100:00100000:0.0:1787864772.196964:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825902720:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864772.196993:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825902720:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (4710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864772.196999:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 367 00000100:00080000:0.0:1787864772.197121:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864772.197846:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825902976:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 3026us (5514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864772.197862:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 211 00000100:00100000:1.0:1787864772.199255:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825903232:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 4201us (6884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864772.199257:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825903104:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2687us (7174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864772.199288:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 212 00000100:00100000:3.0:1787864772.199290:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:0.0:1787864772.378729:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864772.378752:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864772.378816:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864772.378976:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860160 00000100:00100000:3.0:1787864772.378983:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860160 00000100:00100000:3.0:1787864772.379036:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787864772.379046:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844860160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864772.379077:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787864772.379145:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844860160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864772.379152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787864772.379249:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844860160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864772.953005:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864773.981949:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864774.939129:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844860416:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.939169:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844860672:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939197:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864774.939226:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844860544:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939263:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844860928:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.939279:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864774.939305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844861056:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.939346:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844861440:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.939353:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.939376:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864774.939378:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844861568:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.939409:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.939413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844861952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864774.939444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864774.939449:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860544 00000100:00100000:1.0:1787864774.939457:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860544 00000100:00100000:3.0:1787864774.939472:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1787864774.939481:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844860288:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.939508:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787864774.939514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864774.939521:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844860544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939541:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844860800:0@lo:400:kworker.0 00000100:00100000:0.0:1787864774.939668:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860416 00000100:00100000:0.0:1787864774.939673:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860416 00000100:00100000:0.0:1787864774.939696:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860928 00000100:00100000:0.0:1787864774.939699:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860928 00000100:00100000:0.0:1787864774.939719:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861056 00000100:00100000:0.0:1787864774.939722:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861056 00000100:00100000:0.0:1787864774.939732:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861440 00000100:00100000:0.0:1787864774.939734:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861440 00000100:00100000:0.0:1787864774.939745:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861568 00000100:00100000:0.0:1787864774.939747:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861568 00000100:00100000:0.0:1787864774.939760:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787864774.939766:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844860416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864774.939827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787864774.939836:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844860928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939882:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.939935:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844861312:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.939962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.939981:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844861824:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940001:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.940026:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861312 00000100:00100000:3.0:1787864774.940030:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861312 00000100:00100000:3.0:1787864774.940056:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861824 00000100:00100000:3.0:1787864774.940059:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861824 00000100:00100000:3.0:1787864774.940078:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864774.940085:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844861312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940122:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844861312:12345-0@lo:400:kworker.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940129:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864774.940143:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787864774.940148:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940186:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844861824:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940192:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1787864774.940237:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c903c0 x1874711844861312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864774.940250:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844861312:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940260:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1787864774.940264:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92757dbde1c0, transno 4294967301 00000100:00100000:3.0:1787864774.940275:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844861824:0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.940300:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844860544:12345-0@lo:400:kworker.0 Request processed in 781us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864774.940309:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787864774.940326:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860800 00000100:00100000:1.0:1787864774.940330:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860800 00000100:00080000:3.0:1787864774.940339:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864774.940344:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864774.940347:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864774.940349:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864774.940370:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787864774.940379:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844860800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940385:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860288 00000100:00100000:3.0:1787864774.940390:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860288 00000100:00100000:3.0:1787864774.940424:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1787864774.940430:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844860800:12345-0@lo:400:kworker.0 Request processed in 51us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940434:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844860288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.940442:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787864774.940470:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787864774.940479:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844860288:12345-0@lo:400:kworker.0 Request processed in 47us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864774.940481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844861056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940492:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1787864774.940526:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1787864774.940528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844861056:12345-0@lo:400:kworker.0 Request processed in 49us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940536:0:6511:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1787864774.940539:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787864774.940558:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787864774.940569:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787864774.940571:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844861440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864774.940583:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844861568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940609:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874711844861440:12345-0@lo:400:kworker.0 Request processed in 42us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940625:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787864774.940635:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844861568:12345-0@lo:400:kworker.0 Request processed in 56us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864774.940643:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787864774.940673:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861952 00000100:00100000:3.0:1787864774.940678:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861952 00000100:00100000:3.0:1787864774.940712:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787864774.940719:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844861952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787864774.940738:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864774.940770:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844861952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.940776:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787864774.940790:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864774.940799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.940821:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844861184:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940845:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.940862:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.940879:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.940938:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864774.940944:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844862080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864774.940967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864774.940993:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861184 00000100:00100000:3.0:1787864774.940997:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861184 00000100:00100000:3.0:1787864774.941021:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844861696 00000100:00100000:3.0:1787864774.941024:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844861696 00000100:00100000:3.0:1787864774.941039:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787864774.941044:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844861184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941078:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844861184:12345-0@lo:400:kworker.0 Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.941093:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787864774.941105:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787864774.941110:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844861696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941140:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844861696:12345-0@lo:400:kworker.0 Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.941145:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787864774.941161:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864774.941168:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844860672 00000100:00100000:3.0:1787864774.941171:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844860672 00000100:00100000:3.0:1787864774.941191:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787864774.941197:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844860672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941224:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844860672:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.941229:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787864774.941257:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844860672:0@lo:400:kworker.0 00010000:00080000:3.0:1787864774.941269:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91e00 x1874711844861184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864774.941277:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844861184:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941287:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844861696:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941319:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844860544:0@lo:400:kworker.0 00010000:00080000:3.0:1787864774.941330:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c921c0 x1874711844861056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864774.941339:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844861056:0@lo:400:kworker.0 00010000:00080000:3.0:1787864774.941359:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c90b40 x1874711844861568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864774.941369:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844861568:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941400:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862080 00000100:00100000:3.0:1787864774.941404:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862080 00000100:00100000:3.0:1787864774.941425:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787864774.941431:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844862080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864774.941442:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864774.941473:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844862080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864774.941478:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787864774.941507:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844862080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864774.941545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844860288:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941556:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844860800:0@lo:400:kworker.0 00000100:00100000:3.0:1787864774.941567:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844861952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864774.941578:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844861440:0@lo:400:kworker.0 00000100:00100000:0.0:1787864774.943983:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844860416:12345-0@lo:400:kworker.0 Request processed in 4191us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864774.943998:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787864774.944384:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844860416:0@lo:400:kworker.0 00000100:00100000:2.0:1787864774.946556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844860928:12345-0@lo:400:kworker.0 Request processed in 6713us (7239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864774.946575:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787864774.946811:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844860928:0@lo:400:kworker.0 00010000:00010000:2.0:1787864775.001077:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787864775.193930:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787864775.196970:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787864775.962734:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864775.962759:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844862208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864775.962828:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864775.962980:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862208 00000100:00100000:2.0:1787864775.962987:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862208 00000100:00100000:2.0:1787864775.963033:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787864775.963054:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844862208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787864775.963086:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787864775.963149:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844862208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864775.963156:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787864775.963308:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844862208:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864776.025254:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864776.473316:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864776.473340:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844862336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864776.473406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864776.473626:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862336 00000100:00100000:2.0:1787864776.473633:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862336 00000100:00100000:2.0:1787864776.473699:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864776.473710:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844862336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864776.473737:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864776.473782:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844862336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864776.473790:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787864776.473928:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787864776.473956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274488492c0 x1874711844862336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864776.473994:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844862336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864776.474736:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558998f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844862464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864776.474772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864776.474861:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862464 00000100:00100000:0.0:1787864776.474867:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862464 00000100:00100000:0.0:1787864776.474939:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787864776.474948:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844862464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864776.474962:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1787864776.476173:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864776.476391:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844862464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1442us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864776.476403:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1787864776.477066:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927558998f00 x1874711844862464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864776.477089:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558998f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844862464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864777.049048:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864777.311643:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311687:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311724:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311766:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311792:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311818:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864777.311844:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903488 00000100:00100000:0.0:1787864777.311853:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903488 00000100:00100000:3.0:1787864777.311932:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903616 00000100:00100000:3.0:1787864777.311936:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903616 00000100:00100000:0.0:1787864777.311942:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 369 00000100:00100000:0.0:1787864777.311950:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825903488:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864777.311971:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904128 00000100:00100000:3.0:1787864777.311974:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904128 00000100:00100000:3.0:1787864777.311986:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903744 00000100:00100000:3.0:1787864777.311989:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903744 00000100:00100000:3.0:1787864777.312001:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904000 00000100:00100000:3.0:1787864777.312003:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904000 00000100:00100000:3.0:1787864777.312016:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 219 00000100:00100000:3.0:1787864777.312022:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903616:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864777.312109:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 220 00000100:00100000:2.0:1787864777.312120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904128:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864777.312181:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756def8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825903488:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 231us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864777.312189:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 369 00000100:00100000:0.0:1787864777.312220:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 221 00000100:00100000:0.0:1787864777.312227:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903744:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864777.313328:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825903872 00000100:00100000:1.0:1787864777.313336:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825903872 00000100:00100000:1.0:1787864777.313382:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 86 00000100:00100000:1.0:1787864777.313390:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903872:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864777.316376:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903616:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 4343us (4732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864777.316391:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 219 00000100:00100000:3.0:1787864777.316429:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 222 00000100:00100000:3.0:1787864777.316441:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904000:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864777.316490:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904000:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 53us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864777.316496:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 222 00000100:00080000:3.0:1787864777.316545:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864777.316551:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864777.316553:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864777.318534:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904128:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 6406us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864777.318548:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 220 00000100:00100000:0.0:1787864777.320680:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903744:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 8444us (8877us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864777.320693:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 221 00000100:00100000:1.0:1787864777.324954:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825903872:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 11551us (13253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864777.324969:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 86 00000100:00100000:1.0:1787864777.497292:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844862592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864777.497365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864777.497568:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862592 00000100:00100000:3.0:1787864777.497575:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862592 00000100:00100000:3.0:1787864777.497620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787864777.497629:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844862592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864777.497664:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787864777.497723:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558998f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844862592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864777.497730:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787864777.497872:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844862592:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787864778.073252:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864779.098088:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864780.058478:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844862720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864780.058548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.058620:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844862848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864780.058645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.058679:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862720 00000100:00100000:1.0:1787864780.058685:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862720 00000100:00100000:0.0:1787864780.060936:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862848 00000100:00100000:0.0:1787864780.060947:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862848 00000100:00100000:2.0:1787864780.061269:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844862976:0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.061327:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864780.061440:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844863488:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.061464:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844862976 00000100:00100000:2.0:1787864780.061468:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864780.061469:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844862976 00000100:00100000:2.0:1787864780.061502:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864000:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.061508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1787864780.061516:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.061524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864780.061545:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787864780.061551:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844863360:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.061559:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756defa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844862976:12345-0@lo:400:kworker.0 Request processed in 45us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864780.061567:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1787864780.061571:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864780.061586:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844863872:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.061596:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863360 00000100:00100000:3.0:1787864780.061599:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863360 00000100:00100000:2.0:1787864780.061606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864780.061621:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787864780.061627:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844863360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.061631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844862976:0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.061655:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864000 00000100:00100000:2.0:1787864780.061659:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864000 00000100:00100000:1.0:1787864780.061749:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787864780.061757:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844862720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864780.061778:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864780.061811:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844862720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864780.061817:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787864780.061845:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844863104:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864780.062269:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fada940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844863360:12345-0@lo:400:kworker.0 Request processed in 642us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864780.062276:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787864780.062282:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844863616:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.062287:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863104 00000100:00100000:3.0:1787864780.062291:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863104 00000100:00100000:1.0:1787864780.062303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864780.062309:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863616 00000100:00100000:3.0:1787864780.062318:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863616 00000100:00100000:1.0:1787864780.062318:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844864128:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062486:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.062506:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787864780.062515:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062535:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.062550:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844863744:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062564:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.062572:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844864256:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864780.062620:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844862720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864780.062637:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863488 00000100:00100000:1.0:1787864780.062646:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863488 00000100:00100000:1.0:1787864780.062671:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863232 00000100:00100000:1.0:1787864780.062673:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863232 00000100:00100000:1.0:1787864780.062686:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787864780.062692:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844863488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062724:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844863488:12345-0@lo:400:kworker.0 Request processed in 33us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864780.062734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787864780.062747:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787864780.062752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062781:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844863232:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864780.062787:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787864780.062809:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844863232:0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.062851:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864128 00000100:00100000:1.0:1787864780.062854:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864128 00000100:00100000:2.0:1787864780.067695:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863872 00000100:00100000:1.0:1787864780.067701:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844863744 00000100:00100000:2.0:1787864780.067706:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863872 00000100:00100000:1.0:1787864780.067706:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844863744 00000100:00100000:1.0:1787864780.067723:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864256 00000100:00100000:1.0:1787864780.067725:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864256 00000100:00100000:1.0:1787864780.067749:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787864780.067750:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787864780.067759:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757e005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844863872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864780.067759:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070128:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757e005c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844863872:12345-0@lo:400:kworker.0 Request processed in 2362us (8512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864780.070141:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787864780.070188:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787864780.070200:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844864128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844864128:12345-0@lo:400:kworker.0 Request processed in 135us (7844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864780.070402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787864780.070422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787864780.070429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844863744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070529:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844863744:12345-0@lo:400:kworker.0 Request processed in 101us (7963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864780.070550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787864780.070564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787864780.070571:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844864256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844864256:12345-0@lo:400:kworker.0 Request processed in 94us (8078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864780.070671:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787864780.070735:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844863360:0@lo:400:kworker.0 00010000:00080000:2.0:1787864780.070750:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274488483c0 x1874711844863872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864780.070761:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844863872:0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070773:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844863488:0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070822:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787864780.070830:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.070914:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864000:12345-0@lo:400:kworker.0 Request processed in 84us (9387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864780.070920:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1787864780.071083:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadf840 x1874711844864000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864780.071094:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864000:0@lo:400:kworker.0 00000100:00080000:2.0:1787864780.071131:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864780.071135:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864780.071138:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864780.071141:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787864780.071198:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274488492c0 x1874711844863744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864780.071209:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844863744:0@lo:400:kworker.0 00010000:00080000:2.0:1787864780.071228:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada580 x1874711844864256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864780.071237:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844864256:0@lo:400:kworker.0 00000100:00100000:2.0:1787864780.071253:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844864128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.071276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787864780.071284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844863616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.071329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844863616:12345-0@lo:400:kworker.0 Request processed in 46us (9024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864780.071335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787864780.071359:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787864780.071369:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844862848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864780.071386:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864780.071429:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844862848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (12783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864780.071435:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787864780.071472:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844862848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864780.071496:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844863104:12345-0@lo:400:kworker.0 Request processed in 3738us (9231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864780.071503:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787864780.071942:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844863104:0@lo:400:kworker.0 00000100:00100000:3.0:1787864780.071954:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844863616:0@lo:400:kworker.0 00010000:00010000:1.0:1787864780.121271:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864781.082384:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864781.082406:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864781.082471:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864781.083177:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864384 00000100:00100000:3.0:1787864781.083184:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864384 00000100:00100000:3.0:1787864781.083236:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787864781.083245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864781.083276:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864781.083342:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864781.083350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864781.083390:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864384:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864781.145033:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864781.593411:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844864640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864781.593490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864781.593714:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864640 00000100:00100000:2.0:1787864781.593721:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864640 00000100:00100000:2.0:1787864781.593774:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787864781.593785:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844864640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864781.593813:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864781.593883:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844864640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864781.593914:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1787864781.594091:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada580 x1874711844864640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864781.594110:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844864640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864781.594232:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864781.594267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864781.594349:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864512 00000100:00100000:1.0:1787864781.594354:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864512 00000100:00100000:1.0:1787864781.594388:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787864781.594396:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787864781.594406:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864781.594446:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864781.594452:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1787864781.594746:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dc8f00 x1874711844864512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864781.594776:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864782.171467:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864782.432617:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864782.432675:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864782.432711:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864782.432753:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904256 00000100:00100000:1.0:1787864782.432768:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904256 00000100:00100000:2.0:1787864782.432811:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904384 00000100:00100000:2.0:1787864782.432817:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904384 00000100:00100000:1.0:1787864782.432834:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 371 00000100:00080000:2.0:1787864782.432842:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864782.432850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825904256:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864782.432935:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904512 00000100:00100000:2.0:1787864782.432940:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904512 00000100:00100000:1.0:1787864782.432966:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825904256:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.432975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 229 00000100:00100000:1.0:1787864782.432976:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 371 00000100:00100000:2.0:1787864782.432987:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825904384:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864782.433025:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825904384:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.433032:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 229 00000100:00100000:2.0:1787864782.433057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 230 00000100:00100000:2.0:1787864782.433064:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825904512:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864782.433089:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825904512:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.433095:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 230 00000100:00080000:2.0:1787864782.433108:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864782.444193:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864782.444241:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864782.444310:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904768 00000100:00100000:1.0:1787864782.444320:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904768 00000100:00100000:2.0:1787864782.444324:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904640 00000100:00100000:2.0:1787864782.444330:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904640 00000100:00100000:1.0:1787864782.444397:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 231 00000100:00100000:2.0:1787864782.444404:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:1.0:1787864782.444410:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825904768:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864782.444418:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825904640:12345-192.168.206.36@tcp:9:kworker.0 00000020:00000080:2.0:1787864782.444441:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc434b8 00000100:00080000:2.0:1787864782.444450:0:8426:0:(import.c:65:import_set_state_nolock()) ffff927447eb8800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787864782.444481:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825904768:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 75us (239us total) trans 0 rc 0/0 00000001:00000004:2.0:1787864782.444495:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1787864782.444508:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 231 00000100:00100000:2.0:1787864782.444617:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+2:2406:x1874711825904640:12345-192.168.206.36@tcp:9:kworker.0 Request processed in 202us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.444626:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 27 00010000:00010000:2.0:1787864782.444646:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864782.444836:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864782.444840:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864782.448261:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864782.448668:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825904896 00000100:00100000:2.0:1787864782.448676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825904896 00000100:00100000:2.0:1787864782.448786:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 232 00000100:00100000:2.0:1787864782.448796:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904896:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864782.448872:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2407:x1874711825904896:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 67us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.448880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 232 00000100:00080000:3.0:1787864782.449029:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864782.618387:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864782.618409:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844864768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864782.618473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864782.618787:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864768 00000100:00100000:2.0:1787864782.618795:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864768 00000100:00100000:2.0:1787864782.619054:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787864782.619064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844864768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864782.619266:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864782.619374:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844864768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 311us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864782.619381:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787864782.621428:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844864768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864783.193025:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864784.217095:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864785.177017:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864785.177040:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864785.177103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864785.177146:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844864896 00000100:00100000:1.0:1787864785.177154:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844864896 00000100:00080000:0.0:1787864785.177190:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864785.177246:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787864785.177255:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864785.177282:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864785.177328:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844864896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864785.177336:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787864785.177401:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844864896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864785.181021:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864785.181042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844865024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864785.181102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864785.181545:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865024 00000100:00100000:0.0:1787864785.181553:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865024 00000100:00100000:0.0:1787864785.181617:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787864785.181625:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844865024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864785.181655:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864785.181700:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844865024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864785.181707:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787864785.181749:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844865024:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787864785.181907:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864785.184224:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844865152:0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.184226:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844865280:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.184326:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844865408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.190782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864785.190841:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844865664:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.191047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864785.191071:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844866176:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.191099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864785.192043:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864785.192087:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865152 00000100:00100000:1.0:1787864785.192094:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865152 00000100:00100000:1.0:1787864785.192142:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1787864785.192151:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844865152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.192917:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844865152:12345-0@lo:400:kworker.0 Request processed in 763us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864785.192917:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865664 00000100:00100000:0.0:1787864785.192925:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865664 00000100:00100000:1.0:1787864785.192931:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1787864785.192968:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787864785.192976:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865280 00000100:00100000:0.0:1787864785.192977:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844865664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.192981:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865280 00000100:00100000:0.0:1787864785.193025:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844865664:12345-0@lo:400:kworker.0 Request processed in 50us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864785.193032:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787864785.193036:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787864785.193043:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844865280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.193058:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866176 00000100:00100000:0.0:1787864785.193063:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866176 00000100:00100000:1.0:1787864785.193087:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844865280:12345-0@lo:400:kworker.0 Request processed in 46us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864785.193095:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787864785.193100:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787864785.193108:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844866176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.193142:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844865280:0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.193153:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844865792:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.194057:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844866176:12345-0@lo:400:kworker.0 Request processed in 947us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864785.194066:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1787864785.194106:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864785.194129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864785.194163:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865792 00000100:00100000:1.0:1787864785.194167:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865792 00000100:00100000:1.0:1787864785.194205:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787864785.194212:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844865792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.194249:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844865792:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864785.194255:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00080000:0.0:1787864785.194303:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864785.194329:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844865152:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.194344:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844865664:0@lo:400:kworker.0 00010000:00080000:0.0:1787864785.194356:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadda40 x1874711844866176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864785.194367:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844866176:0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.194411:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844865792:0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.194422:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844866304:0@lo:400:kworker.0 00000100:00100000:1.0:1787864785.194449:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864785.194566:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866304 00000100:00100000:0.0:1787864785.194571:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866304 00000100:00100000:0.0:1787864785.194615:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787864785.194622:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844866304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.194656:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844866304:12345-0@lo:400:kworker.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864785.194662:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00080000:1.0:1787864785.194715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864785.194738:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844866304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.198818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864785.198938:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844865920:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.198985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864785.199014:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448864f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844866432:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199034:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864785.199059:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787864785.199066:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844865536:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199085:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864785.199101:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844866048:0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199121:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864785.199147:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866048 00000100:00100000:2.0:1787864785.199175:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866048 00000100:00100000:2.0:1787864785.199222:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787864785.199230:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844866048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199351:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844866048:12345-0@lo:400:kworker.0 Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864785.199358:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787864785.199381:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865920 00000100:00100000:2.0:1787864785.199385:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865920 00000100:00100000:2.0:1787864785.199405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866432 00000100:00100000:2.0:1787864785.199407:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866432 00000100:00100000:2.0:1787864785.199424:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865536 00000100:00100000:2.0:1787864785.199426:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865536 00000100:00100000:2.0:1787864785.199441:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787864785.199447:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844865920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199475:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844865920:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864785.199481:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787864785.199490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787864785.199495:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844866432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199518:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844866432:12345-0@lo:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864785.199523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787864785.199532:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787864785.199537:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844865536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864785.199559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844865536:12345-0@lo:400:kworker.0 Request processed in 22us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864785.199565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:2.0:1787864785.199590:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864785.199594:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864785.199635:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844865536:0@lo:400:kworker.0 00010000:00080000:2.0:1787864785.199647:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fade1c0 x1874711844866048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864785.199656:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fade1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844866048:0@lo:400:kworker.0 00010000:00080000:2.0:1787864785.199665:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadf840 x1874711844865920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864785.199673:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844865920:0@lo:400:kworker.0 00010000:00080000:2.0:1787864785.199682:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448864f00 x1874711844866432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864785.199690:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448864f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844866432:0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.211557:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844865408 00000100:00100000:0.0:1787864785.211569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844865408 00000100:00100000:0.0:1787864785.211621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787864785.211631:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844865408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864785.211722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844865408:12345-0@lo:400:kworker.0 Request processed in 92us (12909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864785.211730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787864785.211920:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dc9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844865408:0@lo:400:kworker.0 00010000:00010000:3.0:1787864785.246356:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864785.434235:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787864785.436157:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864786.202117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864786.202139:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844866560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864786.202217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864786.202288:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866560 00000100:00100000:0.0:1787864786.202295:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866560 00000100:00100000:0.0:1787864786.202341:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787864786.202351:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844866560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864786.202384:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864786.202430:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844866560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864786.202437:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787864786.202500:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844866560:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864786.265093:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864786.714448:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864786.714471:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844866688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864786.714537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864786.717558:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866688 00000100:00100000:2.0:1787864786.717572:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866688 00000100:00100000:2.0:1787864786.717681:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864786.717693:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844866688:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864786.717704:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844866816:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864786.717724:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864786.717767:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864786.718156:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844866688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 464us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864786.718166:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787864786.718166:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866816 00000100:00100000:0.0:1787864786.718173:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866816 00000100:00100000:0.0:1787864786.718216:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787864786.718223:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844866816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864786.718243:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864786.718274:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844866816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864786.718281:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1787864786.722558:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fadbc00 x1874711844866688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864786.722586:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fadbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844866688:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787864786.722620:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448866940 x1874711844866816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864786.722633:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844866816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787864787.290982:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864787.550419:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864787.551118:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864787.551164:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864787.551282:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905152 00000100:00100000:2.0:1787864787.551291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905152 00000100:00100000:2.0:1787864787.551342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905408 00000100:00100000:2.0:1787864787.551345:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905408 00000100:00100000:2.0:1787864787.551381:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 239 00000100:00100000:2.0:1787864787.551390:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825905152:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864787.552109:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905024 00000100:00100000:0.0:1787864787.552116:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905024 00000100:00100000:0.0:1787864787.552148:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 373 00000100:00100000:0.0:1787864787.552155:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825905024:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864787.552226:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864787.553831:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825905152:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2437us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864787.553854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 239 00000100:00100000:2.0:1787864787.553880:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905280 00000100:00100000:2.0:1787864787.553886:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905280 00000100:00100000:2.0:1787864787.553942:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 240 00000100:00100000:2.0:1787864787.553951:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825905408:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864787.553992:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825905408:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 43us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864787.554010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 240 00000100:00100000:2.0:1787864787.554023:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 241 00000100:00100000:2.0:1787864787.554029:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825905280:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864787.554170:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825905024:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 1503us (2494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864787.554178:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 373 00000100:00100000:2.0:1787864787.556061:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825905280:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2024us (3828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864787.556073:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 241 00000100:00080000:2.0:1787864787.556102:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864787.556106:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864787.556959:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864787.556984:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905536 00000100:00100000:2.0:1787864787.556991:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905536 00000100:00100000:2.0:1787864787.557049:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 242 00000100:00100000:2.0:1787864787.557057:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825905536:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864787.557100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825905536:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864787.557117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 242 00000100:00080000:1.0:1787864787.557213:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1787864787.738679:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:2.0:1787864787.738688:0:9504:0:(genops.c:885:class_export_put()) final put ffff927447ebd000/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:0.0:1787864787.738765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927447ebd000/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-OST0001 00000020:00000080:0.0:1787864787.738840:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447eb8800 for lustre-OST0001 00000100:00100000:0.0:1787864787.742541:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844866944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864787.742614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864787.743323:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844866944 00000100:00100000:2.0:1787864787.743331:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844866944 00000100:00100000:2.0:1787864787.743464:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787864787.743474:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844866944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864787.743504:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787864787.743567:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844866944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864787.743574:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787864787.743645:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844866944:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864788.313053:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864789.338006:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864789.442938:0:14048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:06:27 (1787864787) 00000100:00100000:3.0:1787864790.297246:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844867328:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297459:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844867072:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297521:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297565:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844867584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297590:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297608:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844868096:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297646:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844868608:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297689:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787864790.297695:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844867456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297738:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844867968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297758:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297771:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844868480:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.297814:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867072 00000100:00100000:1.0:1787864790.297830:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867072 00000100:00100000:1.0:1787864790.297872:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787864790.297880:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.297968:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844867072:12345-0@lo:400:kworker.0 Request processed in 88us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.297975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1787864790.298006:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867456 00000100:00100000:1.0:1787864790.298009:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867456 00000100:00100000:1.0:1787864790.298051:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787864790.298057:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844867456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.298088:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844867456:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.298094:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787864790.298129:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844867456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.298139:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844867072:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298581:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844867840:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298607:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298621:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844868352:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298659:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787864790.298665:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844867200:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298687:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298703:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844867712:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298722:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298737:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844868224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.298771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.298809:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867840 00000100:00100000:3.0:1787864790.298813:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867840 00000100:00100000:0.0:1787864790.299322:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867584 00000100:00100000:0.0:1787864790.299328:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867584 00000100:00100000:0.0:1787864790.299381:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867328 00000100:00100000:0.0:1787864790.299384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867328 00000100:00100000:0.0:1787864790.299400:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864790.299407:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844867584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.299456:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844867584:12345-0@lo:400:kworker.0 Request processed in 50us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.299463:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864790.299490:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787864790.299496:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.299528:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844867328:12345-0@lo:400:kworker.0 Request processed in 32us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.299534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787864790.299554:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868096 00000100:00100000:0.0:1787864790.299558:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868096 00000100:00100000:0.0:1787864790.299596:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868608 00000100:00100000:0.0:1787864790.299600:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868608 00000100:00100000:0.0:1787864790.299615:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867968 00000100:00100000:0.0:1787864790.299618:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867968 00000100:00100000:0.0:1787864790.299638:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868480 00000100:00100000:0.0:1787864790.299641:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868480 00000100:00100000:2.0:1787864790.299645:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864790.299658:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844868096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.299660:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787864790.299672:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864790.299708:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844868096:12345-0@lo:400:kworker.0 Request processed in 54us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864790.299716:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787864790.299723:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844868608:12345-0@lo:400:kworker.0 Request processed in 52us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864790.299735:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787864790.299743:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864790.299747:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844867968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.299772:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787864790.301370:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868352 00000100:00100000:3.0:1787864790.301380:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868352 00000100:00100000:3.0:1787864790.301403:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867200 00000100:00100000:3.0:1787864790.301406:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867200 00000100:00100000:3.0:1787864790.301416:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844867712 00000100:00100000:3.0:1787864790.301418:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844867712 00000100:00100000:3.0:1787864790.301429:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868224 00000100:00100000:3.0:1787864790.301432:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868224 00000100:00100000:2.0:1787864790.302368:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844867968:12345-0@lo:400:kworker.0 Request processed in 41us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864790.302380:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787864790.303600:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844868480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.303692:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844868480:12345-0@lo:400:kworker.0 Request processed in 3912us (5901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.303700:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787864790.304781:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787864790.304810:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844867840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.304879:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844867840:12345-0@lo:400:kworker.0 Request processed in 80us (6271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.304924:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844868736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864790.304968:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864790.304984:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787864790.305001:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844868352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864790.305004:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864790.305013:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844868864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864790.306230:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864790.306282:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787864790.306319:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787864790.306330:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844867200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.306528:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844868352:12345-0@lo:400:kworker.0 Request processed in 1531us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.306537:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787864790.306555:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787864790.306563:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844867712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.306596:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874711844867712:12345-0@lo:400:kworker.0 Request processed in 35us (7873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.306603:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787864790.306615:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787864790.306622:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844868224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.306682:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844868224:12345-0@lo:400:kworker.0 Request processed in 61us (7910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.306689:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:1.0:1787864790.306714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864790.306720:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864790.306723:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864790.306726:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787864790.306778:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc17c00 x1874711844867968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864790.307452:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844867968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.307475:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844868480:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.307486:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844867584:0@lo:400:kworker.0 00010000:00080000:1.0:1787864790.307497:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d4b40 x1874711844868096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864790.307507:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844868096:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.307517:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844868608:0@lo:400:kworker.0 00000100:00100000:1.0:1787864790.307570:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868736 00000100:00100000:1.0:1787864790.307576:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868736 00000100:00100000:1.0:1787864790.307611:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868864 00000100:00100000:1.0:1787864790.307614:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868864 00000100:00100000:1.0:1787864790.307628:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787864790.307634:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844868736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864790.307659:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864790.307790:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844868736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 156us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.307909:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787864790.307927:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787864790.307932:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844868736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864790.307937:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844868864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864790.307950:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864790.308444:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844868864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 508us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.308452:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787864790.308733:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844868864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864790.308948:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844867200:12345-0@lo:400:kworker.0 Request processed in 2620us (10258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864790.308957:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787864790.308995:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844867200:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.309011:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844867712:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.309023:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844868224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864790.309036:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447fc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844867328:0@lo:400:kworker.0 00010000:00080000:3.0:1787864790.309047:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc14f00 x1874711844867840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864790.309166:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844867840:0@lo:400:kworker.0 00010000:00080000:3.0:1787864790.309183:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274482d4000 x1874711844868352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864790.309193:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844868352:0@lo:400:kworker.0 00010000:00010000:2.0:1787864790.361127:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864790.857227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864790.857313:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905664 00000100:00100000:1.0:1787864790.857322:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905664 00000100:00100000:1.0:1787864790.857403:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:1.0:1787864790.857412:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:11096:x1874711825905664:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864790.857431:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864790.857453:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac924 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857513:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857526:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857538:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864790.857582:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787864790.857586:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:2.0:1787864790.857691:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1787864790.857750:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857793:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac924 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857811:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac924 expref: 6 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.857829:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927447234600) 00010000:00010000:1.0:1787864790.857832:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864790.857835:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948c00, rc 0) 00000100:00100000:1.0:1787864790.857973:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:11096:x1874711825905664:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 561us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864790.857981:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:2.0:1787864790.867758:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864790.867858:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905792 00000100:00100000:0.0:1787864790.867867:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905792 00000100:00100000:0.0:1787864790.867955:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:0.0:1787864790.867965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:11097:x1874711825905792:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864790.867983:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864790.868001:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc435a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac92b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868063:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868091:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868102:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868116:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868123:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868130:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868192:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868199:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864790.868234:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787864790.868238:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864790.868258:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868267:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868282:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868289:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868294:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864790.868298:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868305:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868316:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927447234600) 00010000:00010000:0.0:1787864790.868319:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864790.868324:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868329:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc435ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868341:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868345:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868350:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868355:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864790.868363:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868369:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868377:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9275687e8400) 00010000:00010000:0.0:1787864790.868379:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864790.868382:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868387:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc435b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868416:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc435a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac92b expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868428:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac92b expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864790.868435:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9275687e8700) 00010000:00010000:0.0:1787864790.868437:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864790.868439:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31a00, rc 0) 00000100:00100000:0.0:1787864790.869130:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11097:x1874711825905792:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1163us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.869138:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:3.0:1787864790.879357:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864790.879492:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825905920 00000100:00100000:0.0:1787864790.879500:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825905920 00000100:00100000:0.0:1787864790.879590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864790.879600:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11097:x1874711825905920:12345-192.168.206.36@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787864790.879693:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11097:x1874711825905920:12345-192.168.206.36@tcp:900:lhsmtool_posix.0 Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.879701:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:3.0:1787864790.881350:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864790.881478:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906176 00000100:00100000:1.0:1787864790.881485:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906176 00000100:00100000:1.0:1787864790.881701:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:1.0:1787864790.881710:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11097:x1874711825906176:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864790.881727:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864790.881745:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc435c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac932 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881808:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881834:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881847:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881947:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881956:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.881963:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882072:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc435d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882081:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc435d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882088:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc435d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864790.882097:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787864790.882168:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882176:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882183:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882190:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864790.882195:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882213:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882225:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9275687e8700) 00010000:00010000:1.0:1787864790.882228:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864790.882232:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882239:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc435c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882263:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882270:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882276:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882281:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864790.882284:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882291:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882298:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff927447234a00) 00010000:00010000:1.0:1787864790.882300:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864790.882303:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882318:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc435d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882564:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc435c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac932 expref: 10 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882579:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc435d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac932 expref: 9 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864790.882585:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864790.882588:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864790.882590:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948e00, rc 0) 00000100:00100000:1.0:1787864790.882648:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11097:x1874711825906176:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 938us (1303us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787864790.882656:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:2.0:1787864790.885690:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864790.885801:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906304 00000100:00100000:3.0:1787864790.885812:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906304 00000100:00100000:3.0:1787864790.885980:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864790.886001:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11097:x1874711825906304:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787864790.886143:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11097:x1874711825906304:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864790.886151:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:1.0:1787864790.889812:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864790.889904:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906432 00000100:00100000:2.0:1787864790.889915:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906432 00000100:00080000:1.0:1787864790.889962:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787864790.890009:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:2.0:1787864790.890021:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:11097:x1874711825906432:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1787864790.891690:0:13804:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1614us 00000100:00100000:0.0:1787864790.905667:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:11097:x1874711825906432:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 15639us (15860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864790.905680:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:1.0:1787864791.322503:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844868992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864791.322595:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864791.322628:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844868992 00000100:00100000:3.0:1787864791.322638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844868992 00000100:00100000:3.0:1787864791.322701:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787864791.322711:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844868992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864791.322753:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864791.322827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844868992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864791.322835:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787864791.322847:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844868992:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864791.386504:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864791.580329:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787864791.582672:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787864791.833079:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844869120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864791.833173:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864791.833387:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864791.833399:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844869248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864791.833433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864791.833475:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844869120 00000100:00100000:2.0:1787864791.833483:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844869120 00000100:00100000:2.0:1787864791.833535:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844869248 00000100:00100000:2.0:1787864791.833538:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844869248 00000100:00100000:2.0:1787864791.833555:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787864791.833564:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844869120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864791.833601:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864791.833653:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844869120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864791.833660:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787864791.833680:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864791.833687:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844869248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864791.833697:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864791.833727:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844869248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864791.833734:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1787864791.833774:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fada580 x1874711844869248/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864791.833796:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fada580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844869248:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1787864791.833854:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757bcbd2c0 x1874711844869120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864791.833867:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844869120:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864792.410106:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864792.595989:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.596154:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906560 00000100:00100000:2.0:1787864792.596163:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906560 00000100:00100000:2.0:1787864792.596232:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:2.0:1787864792.596242:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11139:x1874711825906560:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864792.596260:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.596280:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc435e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac939 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596340:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596354:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596365:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596379:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596386:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596392:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596444:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596451:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596458:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596464:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864792.596468:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596474:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596486:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927447234600) 00010000:00010000:2.0:1787864792.596489:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864792.596494:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596499:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc435ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596510:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596516:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596522:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596532:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864792.596535:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596541:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596549:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff927448159500) 00010000:00010000:2.0:1787864792.596552:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864792.596554:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596560:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc435f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596589:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc435e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac939 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596599:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927447234600) 00010000:00010000:2.0:1787864792.596602:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864792.596606:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc435e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac939 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.596615:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797e00, rc 0) 00000100:00100000:2.0:1787864792.596671:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11139:x1874711825906560:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 430us (688us total) trans 0 rc 301/301 00000100:00100000:2.0:1787864792.596678:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00080000:1.0:1787864792.597277:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864792.603714:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.603787:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906816 00000100:00100000:0.0:1787864792.603796:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906816 00000100:00100000:0.0:1787864792.603864:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:0.0:1787864792.603873:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+9:11139:x1874711825906816:12345-192.168.206.36@tcp:36:lfs.0 00010000:00010000:0.0:1787864792.603944:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864792.603969:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4359f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac924 expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.603984:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927447234600) 00010000:00010000:0.0:1787864792.603993:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864792.604056:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604069:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604079:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604105:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604113:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604120:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604567:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604577:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604583:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864792.604596:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdbd11c3 reply state 0000000027cb389c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604605:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604611:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864792.604614:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864792.604616:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787864792.604619:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787864792.604625:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604630:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604641:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604647:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864792.604650:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604657:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604664:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927554cabb00) 00010000:00010000:0.0:1787864792.604666:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864792.604669:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604674:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc435fa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864792.604685:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdbd11c3 reply state 0000000027cb389c transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604692:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.604698:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff927554cab100) 00010000:00010000:0.0:1787864792.604700:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864792.604701:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787864792.604781:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fada580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+10:11139:x1874711825906816:12345-192.168.206.36@tcp:36:lfs.0 Request processed in 909us (1075us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787864792.604789:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:2.0:1787864792.673051:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.673086:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.673104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.673125:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.673164:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907200 00000100:00100000:2.0:1787864792.673172:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907200 00000100:00100000:2.0:1787864792.673225:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907072 00000100:00100000:2.0:1787864792.673228:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907072 00000100:00100000:2.0:1787864792.673243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907328 00000100:00100000:2.0:1787864792.673245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907328 00000100:00100000:2.0:1787864792.673263:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 249 00000100:00100000:2.0:1787864792.673271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825907200:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864792.673335:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825907200:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 64us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864792.673343:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 249 00000100:00100000:2.0:1787864792.673359:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 250 00000100:00100000:2.0:1787864792.673364:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825907072:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864792.673389:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448114780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825907072:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864792.673395:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 250 00000100:00100000:2.0:1787864792.673407:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 251 00000100:00100000:2.0:1787864792.673412:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825907328:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864792.673434:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448117c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825907328:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 22us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864792.673439:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 251 00000100:00080000:2.0:1787864792.673454:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864792.673463:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864792.673757:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825906944 00000100:00100000:0.0:1787864792.673763:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825906944 00000100:00100000:0.0:1787864792.673793:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 375 00000100:00100000:0.0:1787864792.673800:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825906944:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864792.673847:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825906944:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 46us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864792.673853:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 375 00000100:00100000:3.0:1787864792.689410:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864792.689437:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907456 00000100:00100000:3.0:1787864792.689444:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907456 00000100:00100000:3.0:1787864792.689499:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:3.0:1787864792.689508:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+10:11147:x1874711825907456:12345-192.168.206.36@tcp:101:lctl.0 00010000:00010000:3.0:1787864792.689528:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864792.689551:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4360f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac940 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689611:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689624:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689635:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864792.689680:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864792.689683:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864792.689718:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689741:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4360f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac940 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689755:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac940 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.689764:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:3.0:1787864792.689773:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864792.689791:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f200, rc 0) 00000100:00100000:3.0:1787864792.689848:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+11:11147:x1874711825907456:12345-192.168.206.36@tcp:101:lctl.0 Request processed in 341us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864792.689856:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:0.0:1787864792.744008:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.746943:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907584 00000100:00100000:2.0:1787864792.746956:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907584 00000100:00100000:2.0:1787864792.747016:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 48 00000100:00100000:2.0:1787864792.747027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:11153:x1874711825907584:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864792.747045:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.747062:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4361d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac947 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747124:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747138:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747289:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747303:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747311:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747317:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747389:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747397:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747422:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864792.747457:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787864792.747461:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864792.747496:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747508:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747514:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747521:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747526:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864792.747530:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747537:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747547:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:2.0:1787864792.747550:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864792.747554:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747560:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747581:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747587:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747594:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747599:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864792.747602:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747607:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747614:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff927554cab100) 00010000:00010000:2.0:1787864792.747616:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864792.747618:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747624:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4362b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747649:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4361d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac947 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747660:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac947 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.747677:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864792.747680:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787864792.747682:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797000, rc 0) 00000100:00100000:2.0:1787864792.747749:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+12:11153:x1874711825907584:12345-192.168.206.36@tcp:101:bash.0 Request processed in 724us (3749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864792.747756:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 48 00000100:00100000:3.0:1787864792.751166:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.751301:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907840 00000100:00100000:0.0:1787864792.751312:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907840 00000100:00100000:0.0:1787864792.751402:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:0.0:1787864792.751424:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+12:11153:x1874711825907840:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864792.751452:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864792.751480:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43639 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac94e expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.751619:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.751636:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.751650:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757215:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757238:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757264:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787864792.757599:0:13804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787864792.757731:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757741:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757748:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757794:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757801:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757818:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757824:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864792.757828:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757836:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.757848:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:1.0:1787864792.757851:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864792.759010:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.759022:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43640 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864792.759109:0:13804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058fcda6c reply state 000000008866b798 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.759123:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.759131:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:1.0:1787864792.759134:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787864792.759138:0:13804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787864792.759183:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43639 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 15 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.759199:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 14 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.759206:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:1.0:1787864792.759208:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864792.759211:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948c00, rc 0) 00000100:00100000:1.0:1787864792.759339:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+15:11153:x1874711825907840:12345-192.168.206.36@tcp:101:bash.0 Request processed in 7927us (8186us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787864792.759348:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:2.0:1787864792.766412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.766727:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825907968 00000100:00100000:0.0:1787864792.766736:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825907968 00000100:00100000:0.0:1787864792.766828:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:0.0:1787864792.766837:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1874711825907968:12345-192.168.206.36@tcp:8:bash.0 00010000:00080000:0.0:1787864792.766920:0:8426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 317 last 0 00000020:00000080:0.0:1787864792.766950:0:8426:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc4365c 00002000:00100000:0.0:1787864792.766974:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 545fdf19-2645-4c06-a6f5-05dea3348b20/ffff927448b15000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864792.766986:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 77, return 77 00002000:00080000:0.0:1787864792.767053:0:8426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864792.767083:0:8426:0:(import.c:65:import_set_state_nolock()) ffff927448b11800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864792.767151:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825907968:12345-192.168.206.36@tcp:8:bash.0 Request processed in 314us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864792.767159:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:1.0:1787864792.774712:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.775406:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825908096 00000100:00100000:0.0:1787864792.775415:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825908096 00000100:00100000:0.0:1787864792.775543:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:0.0:1787864792.775552:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825908096:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864792.775569:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864792.775589:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac955 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864792.775611:0:8820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787864792.775627:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:0.0:1787864792.775631:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864792.775639:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 7 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.775668:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 7 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.775696:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31800, rc 0) 00000100:00100000:0.0:1787864792.775754:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:0:x1874711825908096:12345-192.168.206.36@tcp:101:bash.0 Request processed in 203us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864792.775761:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00080000:2.0:1787864792.778200:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864792.779271:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.779354:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825908224 00000100:00100000:2.0:1787864792.779362:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825908224 00000100:00100000:2.0:1787864792.779416:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:2.0:1787864792.779425:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11153:x1874711825908224:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864792.779441:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.779459:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac95c expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.779487:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.779496:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864792.779500:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864792.779505:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.779538:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.779566:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864792.779580:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844869376:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864792.779675:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757642c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864792.783362:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844869376:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864792.783407:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.783428:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797a00, rc 0) 00000100:00100000:2.0:1787864792.783524:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:11153:x1874711825908224:12345-192.168.206.36@tcp:101:bash.0 Request processed in 4099us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864792.783533:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:1.0:1787864792.784763:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.784829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825908352 00000100:00100000:0.0:1787864792.784836:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825908352 00010000:00010000:0.0:1787864792.784868:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864792.784919:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:0.0:1787864792.784928:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825908352:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864792.784943:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864792.785127:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.785142:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.785164:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c71ba8c/0x2fcb8c294dc43663 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac955 expref: 8 pid: 8820 timeout: 417 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.785180:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864792.785184:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864792.785191:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.785213:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.785248:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864792.785330:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1874711844869504:192.168.206.36@tcp:105: 00000100:00100000:0.0:1787864792.785391:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864792.787196:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa52c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6496:1874711844869504:192.168.206.36@tcp:105: 00010000:00010000:0.0:1787864792.787220:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864792.787310:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825908352:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 2381us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864792.787320:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:1.0:1787864792.788990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.789252:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825908608 00000100:00100000:2.0:1787864792.789260:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825908608 00000100:00100000:2.0:1787864792.789308:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:2.0:1787864792.789318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+15:11153:x1874711825908608:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:2.0:1787864792.789597:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11153:x1874711825908608:12345-192.168.206.36@tcp:35:bash.0 Request processed in 279us (612us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787864792.789604:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:0.0:1787864792.857526:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864792.857550:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844869632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864792.857622:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864792.857772:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844869632 00000100:00100000:1.0:1787864792.857780:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844869632 00000100:00100000:1.0:1787864792.857841:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787864792.857850:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844869632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864792.857880:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1787864792.857961:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844869632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864792.857969:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787864792.858170:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844869632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864792.868388:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.871735:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825908864 00000100:00100000:2.0:1787864792.871748:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825908864 00000100:00100000:2.0:1787864792.871831:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:2.0:1787864792.871840:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11163:x1874711825908864:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864792.871874:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.871908:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc43671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac963 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864792.872308:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787864792.872417:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc43671 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac963 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.872431:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:2.0:1787864792.872435:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864792.872439:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc43671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac963 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.872453:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797e00, rc 0) 00000100:00100000:2.0:1787864792.872564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+17:11163:x1874711825908864:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 725us (4185us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787864792.872572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:3.0:1787864792.880567:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.882193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825909120 00000100:00100000:2.0:1787864792.882210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825909120 00000100:00100000:2.0:1787864792.882869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:2.0:1787864792.882884:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+17:11163:x1874711825909120:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864792.883244:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:11163:x1874711825909120:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 363us (2690us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787864792.883255:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:1.0:1787864792.964991:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.965133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825909248 00000100:00100000:0.0:1787864792.965145:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825909248 00000100:00100000:0.0:1787864792.965278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:0.0:1787864792.965290:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+18:11169:x1874711825909248:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864792.965322:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864792.965348:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4367f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac96a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965464:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965480:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965494:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864792.965547:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787864792.965552:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864792.965575:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965604:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc4367f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac96a expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965625:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac96a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.965703:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864792.965707:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864792.965774:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30600, rc 0) 00000100:00100000:0.0:1787864792.965871:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11169:x1874711825909248:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 582us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864792.965878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:3.0:1787864792.973824:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.974006:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825909504 00000100:00100000:2.0:1787864792.974018:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825909504 00000100:00100000:2.0:1787864792.974106:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:2.0:1787864792.974137:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11169:x1874711825909504:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864792.974326:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.974353:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4368d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac971 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.974496:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.974515:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.974529:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864792.974543:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787864792.974758:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4368d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac971 expref: 22 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.974780:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac971 expref: 21 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864792.974789:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:2.0:1787864792.974792:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864792.974797:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796a00, rc 0) 00000100:00100000:2.0:1787864792.974882:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+21:11169:x1874711825909504:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 749us (1083us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787864792.974940:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:3.0:1787864792.979243:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864792.979629:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825909760 00000100:00100000:2.0:1787864792.979643:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825909760 00000100:00100000:2.0:1787864792.979750:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:2.0:1787864792.979762:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+21:11169:x1874711825909760:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864792.979874:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864792.979950:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac978 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.983584:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864792.983699:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00010000:00010000:3.0:1787864792.983730:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.983747:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864792.983771:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787864792.983991:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825909888 00000100:00100000:1.0:1787864792.984002:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825909888 00010000:00010000:3.0:1787864792.984398:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac978 expref: 25 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.984437:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac978 expref: 24 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864792.984446:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:3.0:1787864792.984466:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787864792.984470:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e200, rc 0) 00000100:00100000:3.0:1787864792.984606:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+24:11169:x1874711825909760:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 4845us (5374us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787864792.984616:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:1.0:1787864792.985374:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:1.0:1787864792.985393:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+23:2409:x1874711825909888:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864792.985422:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864792.985447:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc43694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac971 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864792.985464:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:1.0:1787864792.985468:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864792.985508:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2409:x1874711825909888:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 123us (1816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864792.985516:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:3.0:1787864792.997527:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864792.997646:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910016 00000100:00100000:0.0:1787864792.997659:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910016 00000100:00100000:0.0:1787864792.997757:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:0.0:1787864792.997768:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825910016:12345-192.168.206.36@tcp:1:lfs.0 00010000:00010000:0.0:1787864792.997837:0:8820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.997864:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.997873:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787864792.997883:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864792.997931:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.997976:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864792.997992:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 7 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864792.998009:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8820:1874711844869760:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864792.998126:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864793.001299:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8820:1874711844869760:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864793.001339:0:8820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864793.004351:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.005745:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910144 00000100:00100000:2.0:1787864793.005760:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910144 00002000:00100000:2.0:1787864793.005838:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff927448848000 x1874711825910144/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:644/0 lens 504/0 e 0 to 0 dl 1787864804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864793.005851:0:8429:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448848000 with x1874711825910144 ext(0->12) 00010000:00010000:2.0:1787864793.005863:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 8 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.005884:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 8 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864793.005910:0:8429:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff927448848000 00000100:00100000:2.0:1787864793.006031:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:2.0:1787864793.006045:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825910144:12345-192.168.206.36@tcp:4:lfs.0 00000001:00100000:1.0:1787864793.008023:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000100:00100000:2.0:1787864793.018241:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825910144:12345-192.168.206.36@tcp:4:lfs.0 Request processed in 12182us (13886us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787864793.018260:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00002000:00100000:2.0:1787864793.018277:0:8429:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff927448848000 x1874711825910144/t4294967300(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:644/0 lens 504/448 e 0 to 0 dl 1787864804 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864793.018376:0:8429:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448848000 with x1874711825910144 ext(0->12) 00010000:00010000:2.0:1787864793.018392:0:8429:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.018416:0:8429:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864793.018425:0:8429:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff927448848000 00000100:00100000:0.0:1787864793.024031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864793.024353:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910272 00000100:00100000:1.0:1787864793.024365:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910272 00010000:00010000:1.0:1787864793.024421:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864793.024486:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:1.0:1787864793.024498:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2407:x1874711825910272:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864793.024517:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787864793.024544:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787864793.024547:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787864792 00002000:00010000:1.0:1787864793.024549:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787864792 00002000:00010000:1.0:1787864793.024552:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787864792 00002000:00010000:1.0:1787864793.024554:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787864793.024566:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.024583:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.024619:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c85912ef/0x2fcb8c294dc4366a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac95c expref: 9 pid: 8423 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.024640:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864793.024644:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864793.024667:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.024677:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.024775:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864793.024853:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2407:x1874711825910272:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 357us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864793.024862:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 53 00010000:00010000:0.0:1787864793.027352:0:8820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027378:0:8820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027519:0:8820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027531:0:8820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027541:0:8820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027550:0:8820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864793.027560:0:8820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027573:0:8820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027596:0:8820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.027605:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cec0e85/0x2fcb8c294dc436b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864793.027959:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825910016:12345-192.168.206.36@tcp:1:lfs.0 Request processed in 30185us (30439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864793.027972:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:0.0:1787864793.032586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864793.033666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910528 00000100:00100000:3.0:1787864793.033683:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910528 00000100:00100000:3.0:1787864793.033764:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:3.0:1787864793.033776:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11169:x1874711825910528:12345-192.168.206.36@tcp:35:lfs.0 00000004:00010000:3.0:1787864793.034218:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac978 expref: 22 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864793.034746:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1787864793.035154:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787864793.036876:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1787864793.037094:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864793.037118:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 26 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864793.037128:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864793.037177:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 26 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864793.037323:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 26 pid: 13804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864793.037342:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1874711844869888:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864793.038018:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864793.045091:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864793.045335:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910656 00000100:00100000:1.0:1787864793.045347:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910656 00010000:00010000:1.0:1787864793.045401:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 27 pid: 13804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864793.045504:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:1.0:1787864793.045517:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+27:2410:x1874711825910656:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864793.045535:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864793.045542:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 27 pid: 13804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.045559:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 27 pid: 13804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.045587:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:1.0:1787864793.045615:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.045671:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.045679:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.045712:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864793.045790:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc4364e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac94e expref: 27 pid: 13804 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864793.045819:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+26:2410:x1874711825910656:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 304us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864793.045820:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744884b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1874711844869888:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864793.045848:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864793.045859:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00010000:00010000:0.0:1787864793.045859:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.045864:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864793.046080:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787864793.046221:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787864793.046342:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844870016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787864793.046405:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864793.046442:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864793.046466:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844870016 00000100:00100000:0.0:1787864793.046471:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844870016 00000100:00100000:0.0:1787864793.046521:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787864793.046529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844870016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787864793.046617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844870016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864793.046625:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1787864793.046643:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864793.046669:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844870016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787864793.046847:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787864793.046925:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844870144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787864793.046960:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864793.046977:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864793.046993:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844870144 00000100:00100000:0.0:1787864793.046998:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844870144 00000100:00100000:0.0:1787864793.047027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787864793.047035:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844870144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787864793.047170:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6514:x1874711844870144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (209us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787864793.047178:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787864793.048059:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bbc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844870144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787864793.048131:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787864793.048182:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048193:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048201:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048208:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.048213:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048223:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048241:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:2.0:1787864793.048245:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787864793.048263:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.048271:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc436be lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864793.048407:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787864793.048482:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787864793.048495:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318110605494ns, next at 319110602469ns, rc = 0 00000001:00080000:2.0:1787864793.048501:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787864793.048526:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927447c2d000) 00010000:00010000:2.0:1787864793.048530:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787864793.048537:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc436a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac978 expref: 30 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864793.048848:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+29:11169:x1874711825910528:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 15073us (16275us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787864793.048859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 8 00000020:00080000:2.0:1787864793.048865:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787864793.052731:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.052837:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825910784 00000100:00100000:2.0:1787864793.052850:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825910784 00000100:00100000:2.0:1787864793.052963:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:2.0:1787864793.052974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+29:11169:x1874711825910784:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864793.053004:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864793.053033:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc436c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac97f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.053107:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc436c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac97f expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.053148:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc436c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac97f expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.053171:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.053174:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864793.053178:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797a00, rc 0) 00000100:00100000:2.0:1787864793.053253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11169:x1874711825910784:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 282us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.053261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:1.0:1787864793.057619:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.058343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825911040 00000100:00100000:2.0:1787864793.058357:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825911040 00000100:00100000:2.0:1787864793.058572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:2.0:1787864793.058585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548b68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11169:x1874711825911040:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864793.058965:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548b68c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+31:11169:x1874711825911040:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 382us (1370us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787864793.058975:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:3.0:1787864793.135852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864793.136023:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825911296 00000100:00100000:1.0:1787864793.136034:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825911296 00000100:00100000:1.0:1787864793.136111:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:1.0:1787864793.136123:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+31:11179:x1874711825911296:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864793.136155:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864793.136181:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc436cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac986 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864793.136320:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787864793.136779:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc436cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac986 expref: 33 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.136797:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:1.0:1787864793.136801:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864793.136817:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc436cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac986 expref: 33 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.136859:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949000, rc 0) 00000100:00100000:1.0:1787864793.137118:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744884bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11179:x1874711825911296:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 995us (1277us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1787864793.137128:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:3.0:1787864793.142039:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.142162:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825911424 00000100:00100000:2.0:1787864793.142174:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825911424 00000100:00100000:2.0:1787864793.142262:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:2.0:1787864793.142273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11179:x1874711825911424:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:2.0:1787864793.142382:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142402:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142435:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142450:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142458:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142465:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142563:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142573:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142580:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864793.142639:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.142655:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143039:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143049:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143069:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.143075:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143083:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143097:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864793.143101:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864793.143106:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143113:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc436da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143127:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143133:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143139:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143144:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.143147:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143153:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143171:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:2.0:1787864793.143173:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864793.143176:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143307:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc436e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143373:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143379:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143385:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143389:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.143392:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143398:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143406:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.143409:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864793.143412:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.143418:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864793.143575:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11179:x1874711825911424:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 1300us (1547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.143585:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:3.0:1787864793.146717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.146877:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825911680 00000100:00100000:0.0:1787864793.146904:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825911680 00000100:00100000:0.0:1787864793.146978:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:0.0:1787864793.146990:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11179:x1874711825911680:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864793.147504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+33:11179:x1874711825911680:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 513us (798us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787864793.147515:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864793.187407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.187558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825911936 00000100:00100000:2.0:1787864793.187570:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825911936 00000100:00100000:2.0:1787864793.187644:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:2.0:1787864793.187656:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+33:11182:x1874711825911936:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864793.187876:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864793.188100:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac98d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188288:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188306:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188321:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188334:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188342:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188350:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188509:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188519:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188526:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864793.188538:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787864793.188638:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188646:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188654:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188660:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.188665:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188674:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188688:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864793.188702:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864793.188708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188848:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc436f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188867:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188873:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188878:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.188883:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.188886:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189099:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189109:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:2.0:1787864793.189112:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864793.189114:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189120:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc436fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189406:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc436ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189422:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 35 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.189436:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.189437:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864793.189439:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864793.189519:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11182:x1874711825911936:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1865us (2124us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787864793.189528:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:3.0:1787864793.192551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.192671:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825912064 00000100:00100000:2.0:1787864793.192682:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825912064 00000100:00100000:2.0:1787864793.192763:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:2.0:1787864793.192775:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11182:x1874711825912064:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864793.192883:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.192935:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.192949:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.192995:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193002:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193010:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193016:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864793.193038:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193048:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193062:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.193065:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864793.193070:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.193077:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43712 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864793.193168:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757db1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11182:x1874711825912064:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 395us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.193176:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:1.0:1787864793.198860:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.198976:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825912320 00000100:00100000:2.0:1787864793.198989:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825912320 00000100:00100000:2.0:1787864793.199052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:2.0:1787864793.199063:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11182:x1874711825912320:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864793.199382:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+36:11182:x1874711825912320:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 320us (535us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787864793.199391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864793.415478:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.415576:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825912576 00000100:00100000:0.0:1787864793.415588:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825912576 00000100:00100000:0.0:1787864793.415665:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:0.0:1787864793.415677:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+36:11213:x1874711825912576:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:0.0:1787864793.415720:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864793.415747:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43719 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac994 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.416054:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.416072:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.416086:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864793.416100:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787864793.416256:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43719 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac994 expref: 39 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.416278:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac994 expref: 38 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.416288:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864793.416292:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864793.416301:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30800, rc 0) 00000100:00100000:0.0:1787864793.416963:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11213:x1874711825912576:12345-192.168.206.36@tcp:101:cat.0 Request processed in 1282us (1492us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787864793.416975:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:3.0:1787864793.420551:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.420957:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825912704 00000100:00100000:2.0:1787864793.420971:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825912704 00000100:00100000:2.0:1787864793.421130:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:2.0:1787864793.421143:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:2407:x1874711825912704:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864793.421166:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864793.421212:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac994 expref: 38 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.421236:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.421241:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864793.421323:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:2407:x1874711825912704:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 183us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.421332:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864793.422399:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.422492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825912960 00000100:00100000:0.0:1787864793.422502:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825912960 00000100:00100000:0.0:1787864793.422566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:0.0:1787864793.422576:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:11213:x1874711825912960:12345-192.168.206.36@tcp:35:cat.0 00000100:00100000:0.0:1787864793.422886:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11213:x1874711825912960:12345-192.168.206.36@tcp:35:cat.0 Request processed in 310us (504us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787864793.422935:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00010000:00010000:2.0:1787864793.433234:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864793.478468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.478600:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825913216 00000100:00100000:0.0:1787864793.478613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825913216 00000100:00100000:0.0:1787864793.478692:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:0.0:1787864793.478703:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11219:x1874711825913216:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:0.0:1787864793.478734:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864793.478738:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864793.478775:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac96a expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.478797:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864793.478813:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864793.478829:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc4372e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac99b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.479067:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.479082:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.479092:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.479130:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.479145:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 38 pid: 6511 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864793.479168:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844870272:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864793.479738:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864793.484067:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864793.484251:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825913344 00000100:00100000:1.0:1787864793.484262:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825913344 00010000:00010000:1.0:1787864793.484323:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 39 pid: 6511 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864793.484374:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:1.0:1787864793.484384:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+39:2410:x1874711825913344:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864793.484402:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864793.484410:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 39 pid: 6511 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.484423:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 39 pid: 6511 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.484451:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864793.484457:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.484467:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.484494:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43704 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac98d expref: 39 pid: 6511 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864793.484500:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864793.484527:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdcb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844870272:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864793.484533:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864793.484556:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.484569:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.484576:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864793.484601:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787864793.484608:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+38:2410:x1874711825913344:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 224us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864793.484616:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00010000:00010000:0.0:1787864793.484784:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc4372e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 39 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.484814:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 38 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.484824:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864793.484827:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787864793.484830:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30800, rc 0) 00000100:00100000:0.0:1787864793.484860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11219:x1874711825913216:12345-192.168.206.36@tcp:101:dd.0 Request processed in 6159us (6406us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787864793.484879:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:1.0:1787864793.487884:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.488015:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825913472 00000100:00100000:2.0:1787864793.488026:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825913472 00000100:00100000:2.0:1787864793.488095:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:2.0:1787864793.488106:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11219:x1874711825913472:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:2.0:1787864793.488135:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864793.488160:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43743 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9a2 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488260:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488276:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488289:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488489:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43743 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 40 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488521:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 39 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.488530:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.488533:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864793.488537:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864793.488612:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+39:11219:x1874711825913472:12345-192.168.206.36@tcp:101:dd.0 Request processed in 509us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.488620:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:3.0:1787864793.493472:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.493540:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825913728 00000100:00100000:0.0:1787864793.493554:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825913728 00000100:00100000:0.0:1787864793.493694:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 62 00000100:00100000:0.0:1787864793.493709:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+39:11219:x1874711825913728:12345-192.168.206.36@tcp:36:dd.0 00010000:00010000:0.0:1787864793.494115:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.494137:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.494151:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864793.494203:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1787864793.494228:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbc1bb88 reply state 0000000075038dee transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.494242:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.494250:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864793.494254:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864793.494259:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864793.494397:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+42:11219:x1874711825913728:12345-192.168.206.36@tcp:36:dd.0 Request processed in 691us (938us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1787864793.494405:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 62 00000020:00080000:0.0:1787864793.494410:0:10168:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787864793.812127:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.812661:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825913856 00000100:00100000:2.0:1787864793.812671:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825913856 00000100:00100000:2.0:1787864793.812794:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:2.0:1787864793.812815:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+42:11233:x1874711825913856:12345-192.168.206.36@tcp:101:stat.0 00010000:00010000:2.0:1787864793.812839:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864793.812858:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43758 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.812950:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.812964:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.812974:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.812986:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813006:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813012:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813077:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813087:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813096:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813128:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.813141:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 43 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864793.813155:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844870400:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864793.813320:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864793.824982:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864793.825300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825914112 00000100:00100000:0.0:1787864793.825319:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825914112 00000100:00100000:0.0:1787864793.825380:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:0.0:1787864793.825389:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+44:6197:x1874711825914112:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787864793.825678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+45:6197:x1874711825914112:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 289us (704us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787864793.825686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:2.0:1787864793.825933:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274482d6940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844870400:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864793.825960:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864793.831169:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.832643:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825914240 00000100:00100000:2.0:1787864793.832675:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825914240 00010000:00010000:2.0:1787864793.832724:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 45 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864793.832782:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:2.0:1787864793.832792:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+45:2409:x1874711825914240:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864793.832815:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864793.832823:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 45 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832837:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 45 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832859:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43735 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac99b expref: 45 pid: 6512 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832876:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.832882:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832937:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832945:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.832975:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864793.833027:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+44:2409:x1874711825914240:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 237us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864793.833044:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 56 00010000:00010000:0.0:1787864793.833186:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833195:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864793.833244:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787864793.833250:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864793.833287:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833299:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833308:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833315:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833321:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833327:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864793.833330:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833344:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833354:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864793.833357:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864793.833361:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833367:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc4375f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833379:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833385:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833390:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833396:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864793.833399:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833405:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833411:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:0.0:1787864793.833414:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864793.833417:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833432:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43766 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833464:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43758 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a9 expref: 44 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833477:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a9 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864793.833483:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864793.833486:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864793.833488:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:0.0:1787864793.833514:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+43:11233:x1874711825913856:12345-192.168.206.36@tcp:101:stat.0 Request processed in 20711us (21395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864793.833521:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:1.0:1787864793.907592:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864793.907774:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825914496 00000100:00100000:2.0:1787864793.907785:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825914496 00000100:00100000:2.0:1787864793.908004:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:2.0:1787864793.908017:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+43:11239:x1874711825914496:12345-192.168.206.36@tcp:36:truncate.0 00010000:00010000:2.0:1787864793.908094:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864793.908128:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4376d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a9 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.908151:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.908157:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864793.908380:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.908397:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.908409:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864793.908622:0:8448:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1787864793.908645:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b52293d reply state 00000000f87784ff transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.908661:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864793.908668:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864793.908671:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864793.908691:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864793.909182:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+45:11239:x1874711825914496:12345-192.168.206.36@tcp:36:truncate.0 Request processed in 1164us (1601us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787864793.909193:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 64 00000020:00080000:2.0:1787864793.909199:0:8448:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787864794.039761:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.040109:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825914624 00000100:00100000:2.0:1787864794.040121:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825914624 00000100:00080000:0.0:1787864794.040342:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864794.040397:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:2.0:1787864794.040411:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+45:11253:x1874711825914624:12345-192.168.206.36@tcp:101:stat.0 00010000:00010000:2.0:1787864794.040442:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.040468:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4377b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9b0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040548:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040565:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040580:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040594:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040602:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040609:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040695:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040722:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040729:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.040779:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787864794.040785:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864794.040822:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040836:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040846:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040853:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040860:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040867:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.040871:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040879:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040933:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864794.040943:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.040949:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.040956:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43782 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041161:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041168:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041174:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041179:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.041231:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041238:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041246:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:2.0:1787864794.041249:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.041252:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041257:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43789 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041289:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4377b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041317:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.041324:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.041326:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864794.041329:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031400, rc 0) 00000100:00100000:2.0:1787864794.041472:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+46:11253:x1874711825914624:12345-192.168.206.36@tcp:101:stat.0 Request processed in 1064us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.041480:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:0.0:1787864794.119203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.119347:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825914880 00000100:00100000:2.0:1787864794.119360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825914880 00000100:00100000:2.0:1787864794.119610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:2.0:1787864794.119624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+46:11263:x1874711825914880:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864794.119650:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.119676:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.119818:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787864794.120072:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43797 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b7 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.120089:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:2.0:1787864794.120093:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864794.120098:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b7 expref: 48 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.120144:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:2.0:1787864794.120214:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+47:11263:x1874711825914880:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 593us (1026us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1787864794.120223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:1.0:1787864794.124069:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.124218:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825915136 00000100:00100000:0.0:1787864794.124230:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825915136 00000100:00100000:0.0:1787864794.124306:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:0.0:1787864794.124318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+47:11263:x1874711825915136:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864794.124619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+48:11263:x1874711825915136:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 303us (562us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787864794.124628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:1.0:1787864794.186829:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.186982:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825915392 00000100:00100000:0.0:1787864794.186995:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825915392 00000100:00100000:0.0:1787864794.187107:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:0.0:1787864794.187119:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+48:11269:x1874711825915392:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864794.187150:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864794.187177:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc437a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9be expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.187356:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.187380:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.187396:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.187456:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.187472:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 49 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.187488:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844870528:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864794.187627:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864794.191471:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844870528:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864794.191510:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.191874:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.192289:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825915520 00000100:00100000:2.0:1787864794.192299:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825915520 00010000:00010000:2.0:1787864794.192345:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 50 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.192401:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:2.0:1787864794.192411:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+50:2410:x1874711825915520:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864794.192428:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864794.192436:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 50 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192450:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 50 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192476:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9b0 expref: 50 pid: 6510 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192495:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.192501:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192512:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192536:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.192569:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864794.192871:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+49:2410:x1874711825915520:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 458us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.192880:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00010000:00010000:1.0:1787864794.193065:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.193076:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864794.193099:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787864794.193265:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc437a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 50 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.193286:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 49 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.193295:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.193308:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864794.193312:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31800, rc 0) 00000100:00100000:1.0:1787864794.193429:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+49:11269:x1874711825915392:12345-192.168.206.36@tcp:101:bash.0 Request processed in 6312us (6615us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787864794.193438:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:1.0:1787864794.210122:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.210708:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825915776 00000100:00100000:3.0:1787864794.210722:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825915776 00000100:00100000:3.0:1787864794.210809:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:3.0:1787864794.210822:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+49:11269:x1874711825915776:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:3.0:1787864794.211154:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.211193:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.211207:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864794.211258:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787864794.211285:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ff33062 reply state 00000000d5f29687 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.211300:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.211308:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.211311:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864794.211316:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864794.211432:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+52:11269:x1874711825915776:12345-192.168.206.36@tcp:36:bash.0 Request processed in 611us (1323us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787864794.211442:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 68 00000020:00080000:3.0:1787864794.211448:0:10168:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787864794.217038:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.217096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825915904 00000100:00100000:0.0:1787864794.217124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825915904 00000100:00100000:0.0:1787864794.217208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:0.0:1787864794.217221:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+52:11269:x1874711825915904:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864794.217253:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864794.217281:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc437c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9c5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.217394:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.217413:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 53 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.217423:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.217463:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 53 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.217478:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 53 pid: 13804 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.217494:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844870656:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864794.217593:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864794.219717:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844870656:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864794.219762:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.219861:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864794.219994:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825916032 00000100:00100000:1.0:1787864794.220002:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825916032 00010000:00010000:1.0:1787864794.220053:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 54 pid: 13804 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.220098:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:1.0:1787864794.220110:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+54:2410:x1874711825916032:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864794.220129:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864794.220136:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 54 pid: 13804 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220150:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 54 pid: 13804 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220178:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc437ac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9be expref: 54 pid: 13804 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220211:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.220217:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220228:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220249:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.220282:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864794.220323:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.220340:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.220354:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+53:2410:x1874711825916032:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 245us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.220363:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000004:00200000:0.0:1787864794.220413:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787864794.220420:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864794.220450:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.220484:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc437c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9c5 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.220501:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9c5 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.220509:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864794.220512:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864794.220515:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db30800, rc 0) 00000100:00100000:0.0:1787864794.220546:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+52:11269:x1874711825915904:12345-192.168.206.36@tcp:101:bash.0 Request processed in 3328us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.220567:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:1.0:1787864794.224081:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.224139:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825916288 00000100:00100000:0.0:1787864794.224152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825916288 00000100:00100000:0.0:1787864794.224230:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:0.0:1787864794.224242:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+52:11269:x1874711825916288:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:0.0:1787864794.224725:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548b6bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11269:x1874711825916288:12345-192.168.206.36@tcp:35:bash.0 Request processed in 481us (654us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787864794.224736:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:3.0:1787864794.298827:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.299837:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825916544 00000100:00100000:2.0:1787864794.299854:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825916544 00000100:00100000:2.0:1787864794.299983:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 70 00000100:00100000:2.0:1787864794.299995:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11279:x1874711825916544:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864794.300028:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.300053:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9cc expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.300178:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787864794.301424:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9cc expref: 55 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.301454:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:2.0:1787864794.301458:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864794.301467:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9cc expref: 55 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.301488:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:2.0:1787864794.301605:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11279:x1874711825916544:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1611us (2789us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1787864794.301616:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 70 00000100:00100000:2.0:1787864794.305347:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.305568:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825916672 00000100:00100000:3.0:1787864794.305581:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825916672 00000100:00100000:3.0:1787864794.305661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:3.0:1787864794.305673:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11279:x1874711825916672:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:3.0:1787864794.305764:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.305785:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307152:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307177:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307188:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307196:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307305:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307314:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307321:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864794.307386:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307403:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307410:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307417:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307442:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.307447:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307456:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307472:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864794.307475:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.307481:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307488:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc437dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307505:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307511:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307517:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307523:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ec00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.307526:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307532:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307551:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:3.0:1787864794.307554:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.307557:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307563:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc437e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307573:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307579:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307584:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307589:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.307592:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307598:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307606:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.307609:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.307612:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.307618:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc437eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.307737:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11279:x1874711825916672:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 2061us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.307749:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:1.0:1787864794.313631:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.313750:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825916928 00000100:00100000:3.0:1787864794.313761:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825916928 00000100:00100000:3.0:1787864794.314825:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:3.0:1787864794.314846:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11279:x1874711825916928:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:3.0:1787864794.315558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+55:11279:x1874711825916928:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 716us (1936us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787864794.315569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:0.0:1787864794.355391:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.355520:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825917184 00000100:00100000:2.0:1787864794.355529:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825917184 00000100:00100000:2.0:1787864794.355683:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 72 00000100:00100000:2.0:1787864794.355694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+55:11282:x1874711825917184:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864794.355716:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.355734:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc437f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.355819:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.355833:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.355844:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356111:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356121:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356129:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356225:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43807 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356246:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356436:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43807 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.356447:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787864794.356520:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356528:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356534:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356540:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.356545:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356553:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356565:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864794.356568:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.356573:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356579:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc437f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356591:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356604:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.356849:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357168:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.357172:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357179:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357188:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:2.0:1787864794.357191:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.357195:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357200:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357243:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc437f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9d3 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357270:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43807 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9d3 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.357278:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.357280:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864794.357290:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:2.0:1787864794.357354:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+57:11282:x1874711825917184:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1662us (1971us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787864794.357363:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 72 00000100:00100000:2.0:1787864794.361929:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.362940:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.363002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825917440 00000100:00100000:0.0:1787864794.363011:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825917440 00000100:00100000:0.0:1787864794.363080:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:0.0:1787864794.363090:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+57:2407:x1874711825917440:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864794.363106:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864794.363129:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43807 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9d3 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.363149:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864794.363154:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864794.363221:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+56:2407:x1874711825917440:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 132us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.363229:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:1.0:1787864794.363653:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825917312 00000100:00100000:1.0:1787864794.363668:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825917312 00000100:00100000:1.0:1787864794.363743:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:1.0:1787864794.363752:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+56:11282:x1874711825917312:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:1.0:1787864794.363814:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363828:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363838:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363868:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363873:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363878:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363911:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.363915:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363922:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363930:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.363932:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864794.363936:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.363941:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43815 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.363994:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+56:11282:x1874711825917312:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 243us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.364001:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:2.0:1787864794.366757:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.366846:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825917696 00000100:00100000:3.0:1787864794.366863:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825917696 00000100:00100000:3.0:1787864794.367109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:3.0:1787864794.367119:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+56:11282:x1874711825917696:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:3.0:1787864794.367338:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+57:11282:x1874711825917696:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 221us (589us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787864794.367346:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00010000:00010000:2.0:1787864794.457830:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864794.515495:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.515600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825917952 00000100:00100000:2.0:1787864794.515609:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825917952 00000100:00100000:2.0:1787864794.515674:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 74 00000100:00100000:2.0:1787864794.515684:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+57:11300:x1874711825917952:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:2.0:1787864794.515705:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.515724:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4381c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9da expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.515871:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43823 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.515884:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43823 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.515921:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43823 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.515932:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787864794.516208:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4381c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9da expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.516226:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43823 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9da expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.516241:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.516244:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787864794.516247:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:2.0:1787864794.516308:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11300:x1874711825917952:12345-192.168.206.36@tcp:101:cat.0 Request processed in 625us (821us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787864794.516316:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 74 00000100:00100000:1.0:1787864794.551215:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.551770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918080 00000100:00100000:0.0:1787864794.551779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918080 00000100:00100000:0.0:1787864794.551931:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 75 00000100:00100000:0.0:1787864794.551943:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11301:x1874711825918080:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864794.551967:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864794.551987:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9e1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552054:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552069:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552097:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864794.552138:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787864794.552142:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864794.552159:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552186:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e1 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552204:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e1 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.552212:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864794.552215:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864794.552219:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757db31800, rc 0) 00000100:00100000:0.0:1787864794.552283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11301:x1874711825918080:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 343us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.552290:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 75 00000100:00100000:1.0:1787864794.562620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.562701:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918464 00000100:00100000:3.0:1787864794.562710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918464 00000100:00100000:3.0:1787864794.562763:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:3.0:1787864794.562773:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11301:x1874711825918464:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:3.0:1787864794.563164:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11301:x1874711825918464:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 392us (552us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787864794.563186:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:3.0:1787864794.571046:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.571135:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918592 00000100:00100000:2.0:1787864794.571143:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918592 00000100:00100000:2.0:1787864794.571202:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:2.0:1787864794.571212:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11301:x1874711825918592:12345-192.168.206.36@tcp:103:lfs.0 00010000:00010000:2.0:1787864794.571226:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787864794.571248:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc437c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9c5 expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.571283:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43823 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9da expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.571296:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc436c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac97f expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.571305:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.571309:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864794.571364:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11301:x1874711825918592:12345-192.168.206.36@tcp:103:lfs.0 Request processed in 153us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.571371:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:1.0:1787864794.577452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.577545:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918720 00000100:00100000:2.0:1787864794.577554:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918720 00000100:00100000:2.0:1787864794.577638:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:2.0:1787864794.577648:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11301:x1874711825918720:12345-192.168.206.36@tcp:58:lfs.0 00010000:00010000:2.0:1787864794.577751:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.577766:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.577776:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864794.578065:0:8448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864794.578204:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787864794.578401:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787864794.578529:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11301:x1874711825918720:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 880us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.578538:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:1.0:1787864794.606479:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.606594:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918848 00000100:00100000:3.0:1787864794.606603:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918848 00000100:00100000:3.0:1787864794.606658:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 77 00000100:00100000:3.0:1787864794.606667:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11303:x1874711825918848:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864794.606687:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864794.606707:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43846 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9e8 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606762:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606776:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606786:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606809:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606817:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606823:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606883:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606936:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.606943:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864794.607046:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787864794.607051:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864794.607068:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607081:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607088:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607094:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607100:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607105:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.607109:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607115:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607126:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864794.607135:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.607140:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607146:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4384d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607158:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607162:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607168:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607172:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.607175:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607180:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607187:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:3.0:1787864794.607190:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.607193:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607198:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43854 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607223:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43846 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 60 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607247:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 59 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.607254:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.607256:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864794.607258:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e800, rc 0) 00000100:00100000:3.0:1787864794.607466:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11303:x1874711825918848:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 799us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.607475:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 77 00000040:00080000:0.0:1787864794.649168:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864794.649178:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864794.649224:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787864794.649234:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864794.649353:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844870784:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787864794.649453:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864794.654300:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.654332:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274472c7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844870784:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864794.654438:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825918976 00000100:00100000:2.0:1787864794.654445:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825918976 00000100:00100000:2.0:1787864794.654492:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 78 00000100:00100000:2.0:1787864794.654500:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11310:x1874711825918976:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864794.654528:0:6511:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864794.655552:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11310:x1874711825918976:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 1048us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.655561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 78 00000100:00100000:1.0:1787864794.664523:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.664912:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825919104 00000100:00100000:0.0:1787864794.664920:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825919104 00000100:00100000:0.0:1787864794.664975:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 79 00000100:00100000:0.0:1787864794.665051:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11310:x1874711825919104:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787864794.665113:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665129:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665139:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665193:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665201:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665207:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665251:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665261:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665268:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864794.665320:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787864794.665329:0:13804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864794.665342:0:13804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665354:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665360:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665365:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665371:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864794.665374:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.665381:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666052:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:0.0:1787864794.666057:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864794.666063:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666071:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30600/0x2fcb8c294dc43862 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666085:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666091:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666109:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666114:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864794.666117:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666124:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666131:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff927554cabb00) 00010000:00010000:0.0:1787864794.666133:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864794.666136:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666141:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30800/0x2fcb8c294dc43869 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666155:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666160:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666166:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666171:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbc00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864794.666174:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666190:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666198:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:0.0:1787864794.666200:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864794.666204:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.666209:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.666287:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11310:x1874711825919104:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 Request processed in 1238us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.666296:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 79 00000100:00100000:1.0:1787864794.669129:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.669252:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825919360 00000100:00100000:2.0:1787864794.669261:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825919360 00000100:00100000:2.0:1787864794.669330:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 80 00000100:00100000:2.0:1787864794.669340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11310:x1874711825919360:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.669356:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.669374:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43877 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669461:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669475:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669486:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864794.669496:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787864794.669563:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669570:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669576:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669583:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.669587:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669594:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669614:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:2.0:1787864794.669617:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864794.669621:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669628:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc4387e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669665:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43877 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9ef expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669673:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:2.0:1787864794.669675:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864794.669679:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc43877 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9ef expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.669688:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:2.0:1787864794.669740:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825919360:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 402us (618us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1787864794.669748:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 80 00000100:00100000:1.0:1787864794.680190:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.680353:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825919488 00000100:00100000:2.0:1787864794.680362:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825919488 00000100:00100000:2.0:1787864794.680460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:2.0:1787864794.680471:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825919488:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864794.680508:0:6511:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864794.680661:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825919488:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 191us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.680684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:1.0:1787864794.684982:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.685180:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825919744 00000100:00100000:2.0:1787864794.685192:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825919744 00000100:00100000:2.0:1787864794.685253:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 82 00000100:00100000:2.0:1787864794.685264:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825919744:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.685283:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.685286:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864794.685310:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31800/0x2fcb8c294dc43838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e1 expref: 60 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.685330:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864794.685335:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864794.685349:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4388c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9f6 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864794.685699:0:8448:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787864794.686378:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43893 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.686393:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.686404:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43893 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.686457:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4388c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9f6 expref: 62 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.686488:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43893 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9f6 expref: 61 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.686496:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159000) 00010000:00010000:2.0:1787864794.686500:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864794.686503:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030200, rc 0) 00000100:00100000:2.0:1787864794.686574:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11310:x1874711825919744:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1310us (1605us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787864794.686582:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 82 00000100:00100000:1.0:1787864794.700936:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.701057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920000 00000100:00100000:2.0:1787864794.701074:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920000 00000100:00100000:2.0:1787864794.701176:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 83 00000100:00100000:2.0:1787864794.701190:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11310:x1874711825920000:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.701264:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864794.701296:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43893 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9f6 expref: 61 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701317:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159000) 00010000:00010000:2.0:1787864794.701328:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864794.701356:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701371:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701383:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701413:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701421:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701428:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701485:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701492:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701499:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701505:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.701510:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701518:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701526:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864794.701529:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.701533:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701540:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc438a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701558:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701565:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701571:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701577:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864794.701580:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701586:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701594:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1cc1b231 (ffff927448159f00) 00010000:00010000:2.0:1787864794.701596:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864794.701599:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.701605:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1cc1b231 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.701723:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825920000:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 536us (794us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864794.701731:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 83 00000100:00100000:1.0:1787864794.709581:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.709654:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920128 00000100:00100000:2.0:1787864794.709669:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920128 00000100:00100000:2.0:1787864794.710040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 84 00000100:00100000:2.0:1787864794.710070:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11310:x1874711825920128:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.710222:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864794.710253:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc438af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ac9fd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710291:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710304:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710314:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710420:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc438af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 62 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710436:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 61 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.710443:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:2.0:1787864794.710445:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864794.710448:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864794.710515:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11310:x1874711825920128:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 449us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.710523:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 84 00000100:00100000:1.0:1787864794.715006:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.715363:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920384 00000100:00100000:2.0:1787864794.715372:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920384 00000100:00100000:2.0:1787864794.715437:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 85 00000100:00100000:2.0:1787864794.715455:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11310:x1874711825920384:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.715534:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.715552:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.715564:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864794.715726:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787864794.715736:0:8448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319777846927ns, next at 320777844510ns, rc = 0 00000004:00010000:2.0:1787864794.715782:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f52cc570 reply state 00000000a16d3445 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.715804:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.715812:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:2.0:1787864794.715815:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787864794.715818:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864794.715943:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11310:x1874711825920384:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 489us (943us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787864794.715951:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 85 00000100:00100000:1.0:1787864794.722203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.722427:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920512 00000100:00100000:3.0:1787864794.722435:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920512 00000100:00100000:3.0:1787864794.722483:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 86 00000100:00100000:3.0:1787864794.722491:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11310:x1874711825920512:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864794.722511:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864794.722528:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca04 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.722575:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 64 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.722588:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 64 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.722604:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:3.0:1787864794.722607:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864794.722616:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ec00, rc 0) 00000100:00100000:3.0:1787864794.722667:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+64:11310:x1874711825920512:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 176us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.722673:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 86 00000100:00100000:1.0:1787864794.735520:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.735620:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920640 00000100:00100000:0.0:1787864794.735629:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920640 00000100:00100000:0.0:1787864794.735701:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:0.0:1787864794.735708:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1874711825920640:12345-192.168.206.36@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787864794.735740:0:8426:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:0.0:1787864794.735767:0:8426:0:(genops.c:1385:class_connect()) connect: client 545fdf19-2645-4c06-a6f5-05dea3348b20, cookie 0x2fcb8c294dc438cb 00002000:00100000:0.0:1787864794.735777:0:8426:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 545fdf19-2645-4c06-a6f5-05dea3348b20/ffff92757fb47800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864794.735794:0:8426:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 77, return 77 00002000:00080000:0.0:1787864794.735885:0:8426:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787864794.735947:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92757fb42800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864794.736027:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2406:x1874711825920640:12345-192.168.206.36@tcp:8:lhsmtool_posix.0 Request processed in 317us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.736049:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:1.0:1787864794.737914:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.737998:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825920768 00000100:00100000:2.0:1787864794.738006:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825920768 00000100:00100000:2.0:1787864794.738073:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:2.0:1787864794.738083:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:0:x1874711825920768:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787864794.738260:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787864794.753562:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1787864794.753575:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000100:00100000:1.0:1787864794.753806:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:0:x1874711825920768:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 15709us (15910us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787864794.753818:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:1.0:1787864794.757787:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.757932:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921024 00000100:00100000:0.0:1787864794.757941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921024 00000100:00100000:0.0:1787864794.758118:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:0.0:1787864794.758129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+64:11310:x1874711825921024:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864794.758519:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11310:x1874711825921024:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 391us (739us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787864794.758527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864794.762182:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.762405:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921280 00000100:00100000:3.0:1787864794.762413:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921280 00000100:00100000:3.0:1787864794.762468:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 87 00000100:00100000:3.0:1787864794.762477:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11310:x1874711825921280:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787864794.762708:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11310:x1874711825921280:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 231us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.762716:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 87 00000100:00100000:1.0:1787864794.766997:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.768926:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921408 00000100:00100000:0.0:1787864794.768938:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921408 00000100:00100000:0.0:1787864794.768989:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 88 00000100:00100000:0.0:1787864794.768999:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11310:x1874711825921408:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864794.769018:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864794.769109:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc438d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca0b expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769175:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769188:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769200:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864794.769240:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864794.769258:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769292:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc438d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca0b expref: 67 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769307:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca0b expref: 66 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.769315:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:0.0:1787864794.769318:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787864794.769322:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bba00, rc 0) 00000100:00100000:0.0:1787864794.769384:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11310:x1874711825921408:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 386us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.769391:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 88 00000100:00100000:1.0:1787864794.775859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.775951:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921536 00000100:00100000:3.0:1787864794.775960:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921536 00000100:00100000:3.0:1787864794.776021:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:3.0:1787864794.776032:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825921536:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864794.776056:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864794.776074:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca12 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864794.776100:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a6da, blocks: 0x0 00010000:00010000:3.0:1787864794.776116:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1787864794.776121:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864794.776130:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.776160:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 6 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.776172:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f000, rc 0) 00000100:00100000:3.0:1787864794.776218:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825921536:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 188us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.776225:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:3.0:1787864794.779811:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864794.779878:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921792 00000100:00100000:1.0:1787864794.779910:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921792 00000100:00100000:1.0:1787864794.779957:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 89 00000100:00100000:1.0:1787864794.779966:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11310:x1874711825921792:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864794.780076:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11310:x1874711825921792:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 110us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.780084:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 89 00000100:00100000:1.0:1787864794.788984:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.789153:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825921920 00000100:00100000:3.0:1787864794.789162:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825921920 00000100:00100000:3.0:1787864794.789206:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:3.0:1787864794.789216:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:11310:x1874711825921920:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864794.789232:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864794.789248:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca19 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.789276:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.789285:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864794.789290:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864794.789295:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 7 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.789339:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.789362:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.789376:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844870912:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864794.789460:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864794.795123:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844870912:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864794.795157:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 7 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.795178:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ee00, rc 0) 00000100:00100000:3.0:1787864794.795228:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11310:x1874711825921920:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 6012us (6250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.795236:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:1.0:1787864794.803035:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.806565:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922048 00000100:00100000:2.0:1787864794.806591:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922048 00010000:00010000:2.0:1787864794.806633:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.806708:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:2.0:1787864794.806718:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825922048:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864794.806732:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864794.806752:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.806766:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.806788:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042f55253/0x2fcb8c294dc438e0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca12 expref: 7 pid: 8423 timeout: 419 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.806817:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864794.806821:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864794.806829:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 6 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.806839:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 6 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.806874:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 6 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.806928:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1874711844871040:192.168.206.36@tcp:105: 00000100:00100000:2.0:1787864794.807006:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864794.812874:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1874711844871040:192.168.206.36@tcp:105: 00010000:00010000:2.0:1787864794.812935:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864794.812982:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825922048:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 6265us (9953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.812993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:1.0:1787864794.816365:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.816446:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922176 00000100:00100000:0.0:1787864794.816455:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922176 00002000:00100000:0.0:1787864794.816497:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff927448888780 x1874711825922176/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:645/0 lens 504/0 e 0 to 0 dl 1787864805 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864794.816508:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448888780 with x1874711825922176 ext(0->8) 00002000:00010000:0.0:1787864794.816513:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448888780 00000100:00100000:0.0:1787864794.816542:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:0.0:1787864794.816552:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825922176:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787864794.822172:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825922176:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 Request processed in 5613us (5805us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787864794.822185:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00002000:00100000:0.0:1787864794.822197:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff927448888780 x1874711825922176/t4294967303(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:645/0 lens 504/448 e 0 to 0 dl 1787864805 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864794.822227:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448888780 with x1874711825922176 ext(0->8) 00002000:00010000:0.0:1787864794.822233:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448888780 00000100:00100000:1.0:1787864794.829229:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864794.829292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922304 00000100:00100000:2.0:1787864794.829305:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922304 00000100:00100000:2.0:1787864794.829411:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 90 00000100:00100000:2.0:1787864794.829420:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11310:x1874711825922304:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787864794.838302:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1787864794.838317:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1787864794.838380:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787864794.838407:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9274471d9d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787864794.838412:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc65700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9274471d9a80 00000020:00080000:0.0:1787864794.838416:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc65b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff927447284600 00010000:00010000:1.0:1787864794.838499:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838510:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838531:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838537:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838542:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838560:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838576:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff927554cab100) 00010000:00010000:1.0:1787864794.838579:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.838584:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838590:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31400/0x2fcb8c294dc43601 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838607:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838612:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838618:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838623:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838625:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838639:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838647:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:1.0:1787864794.838649:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.838652:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838658:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30200/0x2fcb8c294dc43608 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838673:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838678:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838684:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838689:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838691:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838696:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838702:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d900) 00010000:00010000:1.0:1787864794.838704:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.838707:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838718:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43647 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838733:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838739:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838743:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838747:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838750:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838755:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838761:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.838763:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.838766:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838771:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db30a00/0x2fcb8c294dc43751 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838778:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838783:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838804:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838810:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838813:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838819:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838827:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.838829:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.838832:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838838:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43774 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838850:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838857:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838863:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838869:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.838872:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.838886:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.838916:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864794.838933:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844871168:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1787864794.838950:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1787864794.838955:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864794.838968:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844871296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787864794.838995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864794.839038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864794.839079:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844871168 00000100:00100000:2.0:1787864794.839086:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844871168 00000100:00100000:2.0:1787864794.839129:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844871296 00000100:00100000:2.0:1787864794.839132:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844871296 00000100:00100000:2.0:1787864794.839162:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000020:00080000:3.0:1787864794.839166:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787864794.839171:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844871168:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864794.839180:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864794.839188:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844871296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787864794.839188:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00080000:2.0:1787864794.839193:0:8426:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00000100:00100000:0.0:1787864794.839199:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:2.0:1787864794.839220:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a90a6d8, atime: 0x6a90a6d8, ctime: 0x6a90a6d8, blocks: 0x8 00010000:00010000:2.0:1787864794.839227:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.839252:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:2.0:1787864794.839256:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864794.839263:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864794.839268:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787864794.839270:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787864794 00002000:00010000:3.0:1787864794.839273:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787864794.839275:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787864794 -> 1787864794 00002000:00010000:3.0:1787864794.839277:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787864794.839280:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.839287:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.839295:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.839310:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864794.839322:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844871296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (284us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787864794.839335:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1787864794.839374:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92757fb1cb40/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787864794.839380:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844871296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787864794.839404:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1874711844871168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 233us (409us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787864794.839411:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:0.0:1787864794.839427:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9275589983c0/2, rc 0, transno 4294967302 00000100:00100000:0.0:1787864794.839435:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844871168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787864794.839513:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11310:x1874711825922304:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 Request processed in 10092us (10290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864794.839522:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 90 00010000:00010000:1.0:1787864794.839552:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.839555:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864794.839559:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839564:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc437ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839577:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839583:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839588:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839593:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864794.839596:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839602:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839610:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:1.0:1787864794.839612:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787864794.839615:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839632:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc438bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787864794.839649:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787864794.839660:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864794.839665:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839673:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864794.839676:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839683:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839695:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839702:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069fc14a5/0x2fcb8c294dc438ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.839716:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864794.839718:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864794.839719:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864794.846151:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.846268:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922432 00000100:00100000:0.0:1787864794.846277:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922432 00000100:00100000:0.0:1787864794.846432:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:0.0:1787864794.846441:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825922432:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787864794.848121:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787864794.848131:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1787864794.848259:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825922432:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 Request processed in 1816us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.848269:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:2.0:1787864794.856075:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.856405:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922688 00000100:00100000:0.0:1787864794.856415:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922688 00000100:00100000:0.0:1787864794.856474:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 91 00000100:00100000:0.0:1787864794.856496:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+14:11310:x1874711825922688:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787864794.856541:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864794.856566:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc438d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca0b expref: 14 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.856585:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:0.0:1787864794.856590:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864794.856616:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.856628:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.856637:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864794.856736:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023cfbc2f reply state 000000002beb2f6d transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.856837:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.856843:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:0.0:1787864794.856846:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864794.856848:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864794.856974:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+15:11310:x1874711825922688:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 479us (907us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787864794.856982:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 91 00000100:00100000:1.0:1787864794.862578:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.862685:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825922816 00000100:00100000:0.0:1787864794.862693:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825922816 00000100:00100000:0.0:1787864794.862759:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:0.0:1787864794.862768:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825922816:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787864794.863083:0:14166:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787864794.863087:0:14166:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787864794 -> 1787864794 00002000:00010000:0.0:1787864794.863101:0:14166:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787864792 00002000:00010000:0.0:1787864794.863104:0:14166:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787864794 -> 1787864794 00002000:00010000:0.0:1787864794.863106:0:14166:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787864794.863167:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825922816:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 399us (596us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787864794.863176:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:1.0:1787864794.865113:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.865209:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923072 00000100:00100000:3.0:1787864794.865216:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923072 00000100:00100000:3.0:1787864794.865266:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 92 00000100:00100000:3.0:1787864794.865275:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+15:11310:x1874711825923072:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787864794.865333:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.865349:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.865364:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.865394:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.865408:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 15 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.865427:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844871424:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864794.865603:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864794.879230:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844871424:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864794.879259:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.879863:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.880754:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923200 00000100:00100000:0.0:1787864794.880761:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923200 00010000:00010000:0.0:1787864794.880808:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 16 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.880848:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:0.0:1787864794.880857:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+16:2410:x1874711825923200:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864794.880870:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864794.880877:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 16 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.880909:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 16 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.880931:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc438b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9fd expref: 16 pid: 6512 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.880962:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:0.0:1787864794.880967:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.880976:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.880983:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.881007:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864794.881062:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+15:2410:x1874711825923200:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 206us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864794.881070:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 60 00010000:00010000:3.0:1787864794.882905:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882920:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882956:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882964:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882971:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882978:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.882982:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.882990:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.883005:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:3.0:1787864794.883007:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787864794.883012:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.883019:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc438fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.883096:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+14:11310:x1874711825923072:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 Request processed in 17818us (17985us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787864794.883118:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 92 00000100:00100000:1.0:1787864794.897308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.897550:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923328 00000100:00100000:0.0:1787864794.897558:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923328 00000100:00100000:0.0:1787864794.897610:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:0.0:1787864794.897619:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2407:x1874711825923328:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787864794.897670:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.897690:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 7 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.897699:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864794.897703:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864794.897708:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.897750:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 7 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.897765:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 7 pid: 8820 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.897779:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844871552:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864794.897869:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864794.903031:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844871552:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864794.903060:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.903072:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864794.904250:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923456 00000100:00100000:1.0:1787864794.904259:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923456 00010000:00010000:1.0:1787864794.904295:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 8 pid: 8820 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.904348:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:1.0:1787864794.904358:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825923456:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864794.904372:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864794.904392:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 8 pid: 8820 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.904406:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 8 pid: 8820 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.904431:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091809976/0x2fcb8c294dc438e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca19 expref: 8 pid: 8820 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.904447:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864794.904452:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864794.904457:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.904467:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.904507:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864794.904573:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825923456:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 216us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.904581:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 61 00010000:00010000:3.0:1787864794.904992:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905003:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905024:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905033:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905041:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905048:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864794.905052:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905060:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905080:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.905089:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c65162e1/0x2fcb8c294dc43903 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.905143:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825923328:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 Request processed in 7524us (7843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864794.905151:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:2.0:1787864794.913617:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.914656:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923712 00000100:00100000:3.0:1787864794.914667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923712 00000100:00100000:2.0:1787864794.914831:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 93 00000100:00100000:2.0:1787864794.914843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+14:11310:x1874711825923712:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787864794.914943:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.915074:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 14 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.915087:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.915119:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 14 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864794.915133:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 14 pid: 8448 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.915148:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844871680:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864794.915225:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864794.917404:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844871680:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864794.917429:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864794.919150:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864794.919230:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923840 00000100:00100000:1.0:1787864794.919239:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923840 00010000:00010000:1.0:1787864794.919275:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 15 pid: 8448 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.919314:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 62 00000100:00100000:1.0:1787864794.919323:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+15:2408:x1874711825923840:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864794.919337:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864794.919343:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 15 pid: 8448 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919356:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 15 pid: 8448 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919379:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc4374a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9a2 expref: 15 pid: 8448 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919394:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.919399:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919408:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919428:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.919451:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864794.919503:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+14:2408:x1874711825923840:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 181us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.919511:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 62 00010000:00010000:3.0:1787864794.919782:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.919790:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.920021:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.920033:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 14 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.920042:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.920069:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 14 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.920093:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 14 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.920108:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844871808:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864794.920156:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864794.924141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864794.924201:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825923968 00000100:00100000:0.0:1787864794.924208:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825923968 00010000:00010000:0.0:1787864794.924243:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 15 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.924281:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:0.0:1787864794.924291:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+15:2410:x1874711825923968:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864794.924305:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864794.924311:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 15 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.924324:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 15 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.924345:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:0.0:1787864794.924351:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.924375:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.924382:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864794.924401:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864794.924498:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+15:2410:x1874711825923968:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 208us (363us total) trans 0 rc 0/0 00010000:00010000:3.0:1787864794.924508:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc438c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca04 expref: 15 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864794.924508:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:3.0:1787864794.924757:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844871808:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864794.924777:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.924786:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.924792:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864794.924923:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1787864794.925024:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1787864794.925055:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787864794.925849:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1874711844871936:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864794.925935:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864794.925976:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864794.926007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844871936 00000100:00100000:1.0:1787864794.926013:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844871936 00000100:00100000:1.0:1787864794.926056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787864794.926064:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1874711844871936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787864794.926150:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6511:x1874711844871936:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864794.926157:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787864794.926192:0:6511:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787864794.926198:0:6511:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92757fb1cb40, transno 4294967304 00000100:00100000:3.0:1787864794.926220:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1874711844871936:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787864794.926448:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1787864794.926490:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1874711844872064:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787864794.927874:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864794.927943:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872064 00000100:00100000:1.0:1787864794.927951:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872064 00000100:00100000:3.0:1787864794.927962:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01600 going to sleep for 11 seconds 00000100:00100000:1.0:1787864794.928063:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787864794.928073:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6511:x1874711844872064:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787864794.928224:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1874711844872064:12345-0@lo:1000:mdt00_001.0 Request processed in 153us (354us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787864794.928232:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787864794.928358:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6511:1874711844872064:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787864794.928395:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928405:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928412:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928419:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.928423:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928430:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928445:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:3.0:1787864794.928448:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864794.928453:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928459:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43911 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928486:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928504:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928510:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928515:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.928518:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928525:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928534:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.928536:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864794.928539:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928544:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc4383f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928566:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928579:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 17 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928587:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928615:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 17 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.928635:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 17 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.928648:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844872192:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864794.928719:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864794.932097:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844872192:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864794.932126:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.933194:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864794.933316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825924096 00000100:00100000:1.0:1787864794.933324:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825924096 00010000:00010000:1.0:1787864794.933358:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 18 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.933486:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:1.0:1787864794.933497:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+18:2408:x1874711825924096:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864794.933511:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864794.933524:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 18 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933538:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 18 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933559:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4385b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac9e8 expref: 18 pid: 10168 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933574:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:1.0:1787864794.933578:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933588:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933600:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.933629:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864794.933651:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933658:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933669:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.933674:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+17:2408:x1874711825924096:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 179us (484us total) trans 0 rc 0/0 00010000:00010000:3.0:1787864794.933676:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864794.933681:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 64 00010000:00010000:3.0:1787864794.933682:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933687:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.933691:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933708:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933717:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.933721:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864794.933724:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933730:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43918 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933751:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933757:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933762:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933767:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864794.933770:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933776:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933784:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159500) 00010000:00010000:3.0:1787864794.933786:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864794.933790:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.933814:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4390a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864794.933969:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11310:x1874711825923712:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 19123us (20354us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787864794.933979:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 93 00000020:00080000:3.0:1787864794.933982:0:6511:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787864794.934171:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864794.934181:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864794.934200:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787864794.934206:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864794.939962:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864794.940310:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825924352 00000100:00100000:3.0:1787864794.940319:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825924352 00000100:00100000:3.0:1787864794.940375:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:3.0:1787864794.940384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11310:x1874711825924352:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787864794.940837:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787864794.940873:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1787864794.940968:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.940984:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.940996:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.941005:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.941010:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.941016:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864794.941198:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864794.941302:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:11310:x1874711825924352:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 917us (1416us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787864794.941311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000020:00080000:3.0:1787864794.941315:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787864794.941484:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864794.941490:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.941496:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864794.941500:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.941507:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.941519:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:1.0:1787864794.941522:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864794.941526:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.941533:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4391f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864794.941543:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864794.941545:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864794.941547:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787864795.268803:0:14197:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864795.268810:0:14197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787864795.268843:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787864795.268849:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864795.357582:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.357829:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825924608 00000100:00100000:2.0:1787864795.357838:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825924608 00000100:00100000:2.0:1787864795.357917:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 94 00000100:00100000:2.0:1787864795.357928:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+18:11325:x1874711825924608:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864795.357951:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864795.357970:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43926 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca20 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.358205:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4392d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.358220:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4392d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.358231:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4392d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864795.358244:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787864795.358336:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43926 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca20 expref: 21 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.358352:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4392d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca20 expref: 20 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.358361:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864795.358364:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864795.358367:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:2.0:1787864795.358427:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+20:11325:x1874711825924608:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 501us (852us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787864795.358444:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 94 00000100:00100000:1.0:1787864795.362689:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.363172:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825924736 00000100:00100000:2.0:1787864795.363182:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825924736 00000100:00100000:2.0:1787864795.363339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 95 00000100:00100000:2.0:1787864795.363355:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+20:11325:x1874711825924736:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:2.0:1787864795.363429:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363445:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363457:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363472:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363479:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363486:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363571:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363580:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363587:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864795.363646:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363659:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363665:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363672:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363678:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.363682:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363690:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363701:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864795.363704:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.363708:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363715:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc4393b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363726:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363732:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363743:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363749:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.363751:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363758:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363777:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159600) 00010000:00010000:2.0:1787864795.363780:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.363784:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363790:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43942 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363813:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363819:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363825:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363829:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.363832:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363846:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363854:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927448159b00) 00010000:00010000:2.0:1787864795.363857:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.363860:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.363866:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864795.363982:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+20:11325:x1874711825924736:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 633us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.363990:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 95 00000100:00100000:3.0:1787864795.410669:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.410834:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825924992 00000100:00100000:0.0:1787864795.410847:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825924992 00000100:00100000:0.0:1787864795.410964:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 96 00000100:00100000:0.0:1787864795.410985:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+20:11328:x1874711825924992:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864795.411012:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864795.411039:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca27 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411131:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411151:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411166:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411184:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411214:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.411223:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.413729:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.413759:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.413772:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864795.413788:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787864795.413923:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414818:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414829:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414848:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864795.414854:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414864:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414940:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864795.414943:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864795.414950:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414964:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414987:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.414994:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415000:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415005:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864795.415009:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415015:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415025:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927548d9cd00) 00010000:00010000:0.0:1787864795.415028:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864795.415031:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415037:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc4395e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415119:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415138:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.415146:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:0.0:1787864795.415148:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864795.415151:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5baa00, rc 0) 00000100:00100000:0.0:1787864795.416138:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11328:x1874711825924992:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 5155us (5475us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787864795.416152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 96 00000100:00100000:0.0:1787864795.417543:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844872320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864795.417635:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864795.417736:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872320 00000100:00100000:0.0:1787864795.417745:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872320 00000100:00100000:0.0:1787864795.417838:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787864795.417848:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844872320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864795.417873:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1787864795.417967:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447fc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844872320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.417982:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787864795.418042:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844872320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864795.420315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.420496:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744888b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844872448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864795.420576:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864795.420652:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872448 00000100:00100000:0.0:1787864795.420660:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872448 00000100:00100000:0.0:1787864795.420718:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787864795.420729:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844872448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864795.420759:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00080000:2.0:1787864795.420800:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864795.420829:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844872448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.420839:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787864795.420943:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744888b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844872448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864795.421029:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844872576:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421092:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864795.421109:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844872960:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421145:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844873088:0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.421155:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864795.421182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864795.421203:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844873600:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864795.421249:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787864795.421254:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844872704:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421288:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872576 00000100:00100000:2.0:1787864795.421294:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872576 00000100:00100000:2.0:1787864795.421356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787864795.421366:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844872576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421430:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3639:x1874711844872576:12345-0@lo:400:kworker.0 Request processed in 63us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.421438:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1787864795.421472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873088 00000100:00100000:2.0:1787864795.421475:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873088 00000100:00100000:2.0:1787864795.421498:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787864795.421503:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844873088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421552:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844873088:12345-0@lo:400:kworker.0 Request processed in 48us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.421557:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787864795.421574:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873600 00000100:00100000:2.0:1787864795.421577:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873600 00000100:00100000:2.0:1787864795.421604:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864795.421609:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1874711844873600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.421633:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1874711844873600:12345-0@lo:400:kworker.0 Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.421639:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787864795.421659:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864795.427706:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844873472:0@lo:400:kworker.0 00000100:00100000:1.0:1787864795.427709:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825925120 00000100:00100000:1.0:1787864795.427799:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825925120 00000100:00100000:0.0:1787864795.427808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864795.427988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864795.428026:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844873216:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864795.428106:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844873728:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864795.428173:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844872576:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428191:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844873088:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428208:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844873600:0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.428214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787864795.428227:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844872832:0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.428263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864795.428294:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844873344:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428313:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872832 00000100:00100000:3.0:1787864795.428319:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872832 00000100:00100000:0.0:1787864795.428324:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864795.428347:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844873856:0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.428373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864795.428378:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787864795.428390:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844872832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.428414:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873472 00000100:00100000:0.0:1787864795.428420:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873472 00000100:00100000:3.0:1787864795.428465:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844872832:12345-0@lo:400:kworker.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.428472:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787864795.428477:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787864795.428484:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844873472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864795.428522:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872960 00000100:00100000:1.0:1787864795.428528:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872960 00000100:00100000:0.0:1787864795.428540:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844873472:12345-0@lo:400:kworker.0 Request processed in 59us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.428548:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787864795.428571:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844872704 00000100:00100000:1.0:1787864795.428576:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844872704 00000100:00100000:1.0:1787864795.428590:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873216 00000100:00100000:1.0:1787864795.428593:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873216 00000100:00100000:1.0:1787864795.428613:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873728 00000100:00100000:1.0:1787864795.428616:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873728 00000100:00100000:0.0:1787864795.428622:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844872832:0@lo:400:kworker.0 00000100:00100000:1.0:1787864795.428633:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873344 00000100:00100000:1.0:1787864795.428638:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873344 00000100:00100000:0.0:1787864795.428642:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844873472:0@lo:400:kworker.0 00000100:00100000:1.0:1787864795.428654:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844873856 00000100:00100000:1.0:1787864795.428658:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844873856 00000100:00100000:0.0:1787864795.428672:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787864795.428683:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fadf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844872960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864795.428687:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787864795.428698:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844872704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.428768:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844872960:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.428950:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787864795.429085:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844873216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.429152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fadf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844872960:12345-0@lo:400:kworker.0 Request processed in 471us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.429160:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787864795.429180:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787864795.429188:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844873728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.429227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787864795.429234:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844873728:12345-0@lo:400:kworker.0 Request processed in 46us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864795.429241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844873344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.429246:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787864795.429264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787864795.429272:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844873856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.429297:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844873344:12345-0@lo:400:kworker.0 Request processed in 61us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864795.429305:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787864795.429349:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844873856:12345-0@lo:400:kworker.0 Request processed in 78us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.429357:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00010000:00080000:3.0:1787864795.429374:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448b5f840 x1874711844873344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864795.429388:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844873344:0@lo:400:kworker.0 00010000:00080000:3.0:1787864795.429401:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448b5f0c0 x1874711844873856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864795.429410:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844873728:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.429413:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844873856:0@lo:400:kworker.0 00000100:00100000:3.0:1787864795.429471:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:3.0:1787864795.429479:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11328:x1874711825925120:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:3.0:1787864795.429544:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429561:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429572:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429612:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429618:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429632:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429638:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864795.429642:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429649:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429661:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:3.0:1787864795.429664:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864795.429669:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.429675:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.430043:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844872704:12345-0@lo:400:kworker.0 Request processed in 1344us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.430121:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787864795.430853:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11328:x1874711825925120:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 1368us (10540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864795.430865:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:2.0:1787864795.431745:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844873216:12345-0@lo:400:kworker.0 Request processed in 2779us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.431759:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1787864795.431811:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864795.431817:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864795.431821:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864795.432010:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844872704:0@lo:400:kworker.0 00000100:00100000:0.0:1787864795.432029:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844873216:0@lo:400:kworker.0 00000100:00100000:2.0:1787864795.437514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.437727:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825925376 00000100:00100000:0.0:1787864795.437740:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825925376 00000100:00100000:0.0:1787864795.437827:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:0.0:1787864795.437846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548b6b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11328:x1874711825925376:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864795.438181:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548b6b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+23:11328:x1874711825925376:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 341us (681us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1787864795.438192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:1.0:1787864795.468657:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.472245:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825925632 00000100:00100000:3.0:1787864795.472259:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825925632 00000100:00100000:3.0:1787864795.472325:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00100000:3.0:1787864795.472335:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+23:10854:x1874711825925632:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864795.472360:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864795.472380:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc4397a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca2e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.472500:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.472515:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.472523:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.472557:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.472570:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 24 pid: 6512 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864795.472583:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844873984:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864795.473970:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864795.477049:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864795.477178:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825925760 00000100:00100000:1.0:1787864795.477201:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825925760 00010000:00010000:1.0:1787864795.477253:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 25 pid: 6512 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.477309:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:1.0:1787864795.477321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+25:2410:x1874711825925760:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864795.477345:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864795.477356:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 25 pid: 6512 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.477371:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 25 pid: 6512 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.477421:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:1.0:1787864795.477428:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.477438:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.477450:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.477474:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864795.477593:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca27 expref: 25 pid: 6512 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864795.477613:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb1cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844873984:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864795.477650:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.477661:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.477667:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.477689:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+24:2410:x1874711825925760:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 370us (652us total) trans 0 rc 0/0 00000004:00200000:2.0:1787864795.477690:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00000100:00100000:1.0:1787864795.477698:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 65 00010000:00010000:2.0:1787864795.479247:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc4397a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.479278:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.479288:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864795.479292:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864795.479296:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f400, rc 0) 00000100:00100000:2.0:1787864795.479488:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+24:10854:x1874711825925632:12345-192.168.206.36@tcp:101:bash.0 Request processed in 7152us (10839us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787864795.479498:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 98 00010000:00010000:2.0:1787864795.482207:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864795.482918:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.483168:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825925888 00000100:00100000:3.0:1787864795.483182:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825925888 00000100:00100000:3.0:1787864795.483266:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 99 00000100:00100000:3.0:1787864795.483278:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+24:10854:x1874711825925888:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864795.483312:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864795.483416:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4398f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca35 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483462:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483495:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483508:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483662:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4398f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca35 expref: 26 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483681:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca35 expref: 25 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.483691:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:3.0:1787864795.483693:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864795.483697:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e600, rc 0) 00000100:00100000:3.0:1787864795.483776:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+25:10854:x1874711825925888:12345-192.168.206.36@tcp:101:bash.0 Request processed in 500us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864795.483784:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 99 00000100:00100000:1.0:1787864795.486381:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.486463:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926144 00000100:00100000:3.0:1787864795.486475:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926144 00000100:00100000:3.0:1787864795.486546:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 100 00000100:00100000:3.0:1787864795.486556:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+25:10854:x1874711825926144:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:3.0:1787864795.486861:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.486882:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.487290:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864795.487361:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787864795.487405:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f54d1787 reply state 00000000e8a09ce5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.487420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.487429:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:3.0:1787864795.487432:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864795.487436:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787864795.487482:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787864795.487611:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448889e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+29:10854:x1874711825926144:12345-192.168.206.36@tcp:36:bash.0 Request processed in 1052us (1238us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787864795.487619:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 100 00000020:00080000:3.0:1787864795.487625:0:6510:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787864795.491037:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.491241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926272 00000100:00100000:2.0:1787864795.491257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926272 00000100:00100000:2.0:1787864795.491367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 101 00000100:00100000:2.0:1787864795.491379:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+29:10854:x1874711825926272:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864795.491409:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864795.491444:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc439a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca3c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.491522:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc439a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca3c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.491539:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc439a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca3c expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.491561:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864795.491565:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864795.491569:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864795.491644:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+30:10854:x1874711825926272:12345-192.168.206.36@tcp:101:bash.0 Request processed in 268us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.491651:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 101 00000100:00100000:1.0:1787864795.495459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.495674:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926400 00000100:00100000:3.0:1787864795.495687:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926400 00000100:00100000:3.0:1787864795.495762:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:3.0:1787864795.495774:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:10854:x1874711825926400:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864795.495806:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864795.495833:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca43 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864795.495864:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a90a6da, atime: 0x6a90a6d8, ctime: 0x6a90a6da, blocks: 0x8 00010000:00010000:3.0:1787864795.495930:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1787864795.495948:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864795.496071:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.496097:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.496112:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ec00, rc 0) 00000100:00100000:3.0:1787864795.496305:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:10854:x1874711825926400:12345-192.168.206.36@tcp:101:bash.0 Request processed in 532us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864795.496313:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:1.0:1787864795.499542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.499618:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926528 00000100:00100000:2.0:1787864795.499631:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926528 00002000:00010000:2.0:1787864795.499688:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787864795.499694:0:8429:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448889a40 with x1874711825926528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787864795.499710:0:8429:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448889a40. 00000100:00100000:2.0:1787864795.499750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:2.0:1787864795.499761:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825926528:12345-192.168.206.36@tcp:10:bash.0 00002000:00010000:2.0:1787864795.500173:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787864795.500178:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1787864794 -> 1787864795 00002000:00010000:2.0:1787864795.500194:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1787864792 -> 1787864792 00002000:00010000:2.0:1787864795.500196:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1787864794 -> 1787864795 00002000:00010000:2.0:1787864795.500199:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787864795.500281:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448889a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2408:x1874711825926528:12345-192.168.206.36@tcp:10:bash.0 Request processed in 521us (753us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787864795.500290:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00002000:00010000:2.0:1787864795.500295:0:8429:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1787864795.500298:0:8429:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448889a40 with x1874711825926528 ext(0->18446744073709551615) 00002000:00010000:2.0:1787864795.500303:0:8429:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448889a40. 00000100:00100000:0.0:1787864795.587461:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.587829:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926656 00000100:00100000:3.0:1787864795.587840:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926656 00000100:00100000:1.0:1787864795.588127:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 102 00000100:00100000:1.0:1787864795.588142:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11342:x1874711825926656:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:1.0:1787864795.588233:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588255:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588268:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588324:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588332:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588339:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588436:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588447:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588453:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787864795.588514:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588526:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588534:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588541:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588548:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864795.588552:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588567:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588581:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:1.0:1787864795.588585:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864795.588591:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588597:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc439b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588612:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588618:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588624:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588629:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864795.588632:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588638:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588645:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927447c2d200) 00010000:00010000:1.0:1787864795.588648:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864795.588651:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588667:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc439b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588683:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588689:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588695:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588701:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864795.588704:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.588710:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.591385:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:1.0:1787864795.591389:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864795.591399:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.591407:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc439c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.591553:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11342:x1874711825926656:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 3408us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.591567:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 102 00000100:00100000:3.0:1787864795.629342:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.629456:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825926912 00000100:00100000:2.0:1787864795.629465:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825926912 00000100:00100000:2.0:1787864795.629521:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00100000:2.0:1787864795.629531:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11345:x1874711825926912:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864795.629549:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864795.629568:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc439c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca4a expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629634:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629648:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629658:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629673:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629693:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629700:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629823:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc439dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629833:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc439dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629840:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc439dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864795.629851:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787864795.629963:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629970:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629977:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629983:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.629987:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.629994:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630017:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864795.630020:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.630025:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630032:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc439ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630045:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630051:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630057:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630062:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.630065:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630070:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630077:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:2.0:1787864795.630079:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.630082:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630087:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc439d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630136:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc439c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca4a expref: 33 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630149:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc439dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca4a expref: 32 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.630156:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864795.630159:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864795.630161:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030800, rc 0) 00000100:00100000:2.0:1787864795.630276:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11345:x1874711825926912:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 746us (941us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787864795.630284:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00100000:3.0:1787864795.634463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.634533:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825927040 00000100:00100000:2.0:1787864795.634541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825927040 00000100:00100000:2.0:1787864795.634588:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 104 00000100:00100000:2.0:1787864795.634596:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11345:x1874711825927040:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864795.634666:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.634681:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.634691:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.634718:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.634741:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 32 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864795.634755:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844874112:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864795.634850:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864795.637181:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844874112:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864795.637216:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864795.637491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.638178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825927296 00000100:00100000:2.0:1787864795.638187:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825927296 00000100:00100000:2.0:1787864795.638550:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:2.0:1787864795.638560:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+33:10793:x1874711825927296:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787864795.638807:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+34:10793:x1874711825927296:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 248us (1317us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787864795.638815:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:0.0:1787864795.641691:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864795.641774:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825927424 00000100:00100000:1.0:1787864795.641782:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825927424 00010000:00010000:1.0:1787864795.641828:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 34 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.641869:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:1.0:1787864795.641879:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+34:2410:x1874711825927424:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864795.641912:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864795.641919:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 34 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.641933:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 34 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.641952:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43981 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca2e expref: 34 pid: 6511 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.641975:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:1.0:1787864795.641981:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.641990:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.641998:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.642023:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864795.642068:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+33:2410:x1874711825927424:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 190us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.642086:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 66 00010000:00010000:0.0:1787864795.642314:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642323:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642353:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642359:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642366:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642372:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864795.642376:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642384:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642398:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:0.0:1787864795.642401:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864795.642405:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.642411:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc439ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864795.642454:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11345:x1874711825927040:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 7858us (7998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.642462:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 104 00000100:00100000:0.0:1787864795.644929:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.645036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825927680 00000100:00100000:2.0:1787864795.645044:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825927680 00000100:00100000:2.0:1787864795.645096:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:2.0:1787864795.645105:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+32:11345:x1874711825927680:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864795.645393:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+33:11345:x1874711825927680:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 288us (471us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787864795.645401:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00000040:00080000:0.0:1787864795.673812:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787864795.719786:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.720712:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825927936 00000100:00100000:3.0:1787864795.720722:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825927936 00000100:00100000:3.0:1787864795.720786:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 105 00000100:00100000:3.0:1787864795.720808:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+33:11356:x1874711825927936:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:3.0:1787864795.720830:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864795.720849:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc439f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca51 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.720986:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721001:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721018:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721034:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721041:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721048:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721151:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43a06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721161:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721168:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43a06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864795.721178:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787864795.721247:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721255:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721262:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721268:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864795.721278:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721287:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721298:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864795.721302:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864795.721306:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721313:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc439f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721326:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721332:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721338:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721343:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864795.721346:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721352:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721359:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927548558c00) 00010000:00010000:3.0:1787864795.721361:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864795.721371:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721377:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc439ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721426:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc439f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca51 expref: 36 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721440:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43a06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca51 expref: 35 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.721447:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:3.0:1787864795.721450:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864795.721453:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f800, rc 0) 00000100:00100000:3.0:1787864795.721505:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11356:x1874711825927936:12345-192.168.206.36@tcp:101:cat.0 Request processed in 699us (1726us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787864795.721512:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 105 00000100:00100000:3.0:1787864795.728151:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.728246:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825928192 00000100:00100000:2.0:1787864795.728267:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825928192 00000100:00100000:2.0:1787864795.728368:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:2.0:1787864795.728378:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11356:x1874711825928192:12345-192.168.206.36@tcp:35:cat.0 00000100:00100000:2.0:1787864795.728639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+36:11356:x1874711825928192:12345-192.168.206.36@tcp:35:cat.0 Request processed in 262us (496us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1787864795.728647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:0.0:1787864795.749251:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.749331:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825928448 00000100:00100000:2.0:1787864795.749340:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825928448 00000100:00100000:2.0:1787864795.749400:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 106 00000100:00100000:2.0:1787864795.749411:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+36:11358:x1874711825928448:12345-192.168.206.36@tcp:36:rm.0 00010000:00010000:2.0:1787864795.749481:0:13804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787864795.749506:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc439a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca3c expref: 36 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749527:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43a06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca51 expref: 35 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749540:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc439dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca4a expref: 34 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749553:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43996 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca35 expref: 33 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749563:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864795.749568:0:13804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864795.749588:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749626:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749637:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749653:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749661:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749668:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749738:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749747:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.749754:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864795.750018:0:13804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787864795.750029:0:13804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320812139490ns, next at 321812136630ns, rc = 0 00010000:00010000:2.0:1787864795.750070:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750078:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750095:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750103:0:13804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750109:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750114:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750525:0:13804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864795.750546:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750553:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750560:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750566:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.750570:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750578:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750587:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864795.750590:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787864795.750600:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750607:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43a22 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750622:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750628:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750634:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750639:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864795.750642:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750648:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750655:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864795.750657:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864795.750660:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750665:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43a14 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864795.750674:0:13804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd8a3364 reply state 00000000cf7999d2 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750695:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.750702:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:2.0:1787864795.750704:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864795.750706:0:13804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864795.750836:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+34:11358:x1874711825928448:12345-192.168.206.36@tcp:36:rm.0 Request processed in 1425us (1592us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787864795.750845:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 106 00010000:00010000:1.0:1787864795.751441:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864795.751448:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.751455:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864795.751458:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.751465:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.751475:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:1.0:1787864795.751478:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787864795.751481:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.751487:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43a29 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.751498:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864795.751500:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864795.751502:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864795.802846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.802984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825928704 00000100:00100000:3.0:1787864795.802995:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825928704 00000100:00100000:3.0:1787864795.803245:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 107 00000100:00100000:3.0:1787864795.803262:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+34:11364:x1874711825928704:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864795.803291:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864795.803327:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43a30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca58 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803458:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803497:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803510:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803524:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803532:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.803539:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787864795.804002:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787864795.804442:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804458:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804466:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804507:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804514:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804521:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804539:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864795.804544:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804553:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804568:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864795.804571:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864795.804576:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804582:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43a37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864795.804599:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cdd7b79 reply state 00000000051fac02 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804613:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804619:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:3.0:1787864795.804622:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864795.804625:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787864795.804663:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43a30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804680:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 36 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.804700:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:3.0:1787864795.804703:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864795.804705:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ee00, rc 0) 00000100:00100000:3.0:1787864795.804808:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:11364:x1874711825928704:12345-192.168.206.36@tcp:101:bash.0 Request processed in 1550us (1974us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787864795.808280:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 107 00000100:00100000:1.0:1787864795.808452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.808617:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825928832 00000100:00100000:2.0:1787864795.808629:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825928832 00000100:00100000:2.0:1787864795.808743:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:2.0:1787864795.808754:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2407:x1874711825928832:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864795.808776:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864795.808812:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca5f expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864795.808845:0:8820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787864795.808871:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:2.0:1787864795.808876:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864795.808919:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.808942:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.808990:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864795.809061:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2407:x1874711825928832:12345-192.168.206.36@tcp:101:bash.0 Request processed in 309us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.811191:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00080000:0.0:1787864795.811313:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864795.812437:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.812654:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825928960 00000100:00100000:0.0:1787864795.812665:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825928960 00000100:00100000:0.0:1787864795.812726:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:0.0:1787864795.812737:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:11364:x1874711825928960:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864795.812759:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864795.812780:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca66 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.812826:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 9 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.812836:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864795.812855:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864795.812861:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 9 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.812920:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 9 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.812934:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 9 pid: 8820 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864795.812949:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844874240:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864795.813057:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864795.816526:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864795.816635:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825929088 00000100:00100000:1.0:1787864795.816645:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825929088 00010000:00010000:1.0:1787864795.816696:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 10 pid: 8820 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.816770:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:1.0:1787864795.816782:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2409:x1874711825929088:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864795.816815:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864795.816845:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 10 pid: 8820 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.816861:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 10 pid: 8820 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.816930:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864795.816936:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864795.816945:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 10 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.816961:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 10 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.817005:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 10 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.817022:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1874711844874368:192.168.206.36@tcp:105: 00000100:00100000:1.0:1787864795.817286:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864795.820038:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1874711844874368:192.168.206.36@tcp:105: 00010000:00010000:1.0:1787864795.820172:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864795.820246:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2409:x1874711825929088:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 3465us (3731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.820258:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 67 00010000:00010000:0.0:1787864795.821292:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daf47e0d/0x2fcb8c294dc43a53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca5f expref: 9 pid: 8820 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864795.821326:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dccf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844874240:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864795.821356:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.821372:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bae00, rc 0) 00000100:00100000:0.0:1787864795.821431:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:11364:x1874711825928960:12345-192.168.206.36@tcp:101:bash.0 Request processed in 8695us (9003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.821439:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864795.824958:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.825054:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825929344 00000100:00100000:0.0:1787864795.825066:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825929344 00000100:00100000:0.0:1787864795.825202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:0.0:1787864795.825233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:11364:x1874711825929344:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:0.0:1787864795.825644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11364:x1874711825929344:12345-192.168.206.36@tcp:35:bash.0 Request processed in 411us (767us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787864795.825653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:3.0:1787864795.939539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864795.939666:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825929472 00000100:00100000:1.0:1787864795.939678:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825929472 00000100:00100000:1.0:1787864795.939764:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 108 00000100:00100000:1.0:1787864795.939780:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+38:11380:x1874711825929472:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864795.939829:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864795.939854:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43a61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca6d expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.939996:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.940023:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.940039:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864795.940167:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1787864795.940172:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864795.940195:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.940224:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43a61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca6d expref: 40 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.940245:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca6d expref: 39 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.940274:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:1.0:1787864795.940276:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864795.940281:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949000, rc 0) 00000100:00100000:1.0:1787864795.940414:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+39:11380:x1874711825929472:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 635us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.940422:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 108 00000100:00100000:3.0:1787864795.946320:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.946408:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825929728 00000100:00100000:0.0:1787864795.946421:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825929728 00000100:00100000:0.0:1787864795.946553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 109 00000100:00100000:0.0:1787864795.946564:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+39:11380:x1874711825929728:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864795.946591:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864795.946618:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43a6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca74 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.946750:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43a76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.946768:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.946782:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43a76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864795.946805:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787864795.946959:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43a6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca74 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.946979:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43a76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca74 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.947016:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:0.0:1787864795.947020:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864795.947024:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb800, rc 0) 00000100:00100000:0.0:1787864795.947105:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+41:11380:x1874711825929728:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 542us (811us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787864795.947114:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 109 00000100:00100000:3.0:1787864795.952530:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.952586:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.954667:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930112 00000100:00100000:0.0:1787864795.954684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930112 00000100:00100000:0.0:1787864795.954782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 110 00000100:00100000:0.0:1787864795.954805:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+41:11380:x1874711825930112:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864795.954836:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864795.954871:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43a84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca7b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.955029:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.955047:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.955060:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864795.955187:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787864795.955311:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43a84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca7b expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.955356:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca7b expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.955366:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:0.0:1787864795.955370:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864795.955374:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5baa00, rc 0) 00000100:00100000:0.0:1787864795.955527:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+43:11380:x1874711825930112:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 734us (2938us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787864795.955534:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 110 00000100:00100000:2.0:1787864795.955758:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825929856 00000100:00100000:2.0:1787864795.955765:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825929856 00000100:00100000:2.0:1787864795.955818:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:2.0:1787864795.955827:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+43:2410:x1874711825929856:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864795.955838:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864795.955856:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43a76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca74 expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.955870:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:2.0:1787864795.955874:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864795.955917:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+42:2410:x1874711825929856:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 91us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864795.955924:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864795.964525:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.964708:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930240 00000100:00100000:3.0:1787864795.964720:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930240 00000100:00100000:3.0:1787864795.964800:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:3.0:1787864795.964812:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825930240:12345-192.168.206.36@tcp:1:lfs.0 00010000:00010000:3.0:1787864795.964868:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.965152:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864795.965163:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787864795.965169:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864795.965192:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.965385:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 8 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.965404:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 8 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864795.965420:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874711844874496:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864795.965583:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864795.967600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864795.967871:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874711844874496:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864795.967936:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864795.969725:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930368 00000100:00100000:2.0:1787864795.969741:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930368 00002000:00100000:2.0:1787864795.969825:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9274489bb480 x1874711825930368/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:646/0 lens 504/0 e 0 to 0 dl 1787864806 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864795.969838:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274489bb480 with x1874711825930368 ext(0->8) 00010000:00010000:2.0:1787864795.969907:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 9 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.969950:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 9 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864795.969959:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9274489bb480 00000100:00100000:2.0:1787864795.970063:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:2.0:1787864795.970085:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825930368:12345-192.168.206.36@tcp:4:lfs.0 00000100:00100000:2.0:1787864795.971633:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2409:x1874711825930368:12345-192.168.206.36@tcp:4:lfs.0 Request processed in 1540us (4032us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787864795.971650:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00002000:00100000:2.0:1787864795.971663:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9274489bb480 x1874711825930368/t4294967303(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:646/0 lens 504/448 e 0 to 0 dl 1787864806 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864795.971673:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274489bb480 with x1874711825930368 ext(0->8) 00010000:00010000:2.0:1787864795.971683:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.971704:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864795.971713:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9274489bb480 00000100:00100000:3.0:1787864795.976825:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864795.978215:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930496 00000100:00100000:1.0:1787864795.978231:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930496 00010000:00010000:1.0:1787864795.978292:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.978346:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:1.0:1787864795.978357:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2407:x1874711825930496:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864795.978377:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787864795.978401:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787864795.978404:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787864795 00002000:00010000:1.0:1787864795.978406:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787864795 00002000:00010000:1.0:1787864795.978408:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787864795 00002000:00010000:1.0:1787864795.978411:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787864795.978419:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.978434:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.978487:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5025bc/0x2fcb8c294dc43a5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca66 expref: 11 pid: 8423 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.978509:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864795.978515:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864795.978522:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.978533:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.978571:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864795.978646:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2407:x1874711825930496:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 291us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.978660:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 68 00010000:00010000:0.0:1787864795.978962:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.978986:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979010:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979019:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979028:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979036:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864795.979040:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979050:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979064:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864795.979086:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940abf74/0x2fcb8c294dc43a99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864795.979255:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2410:x1874711825930240:12345-192.168.206.36@tcp:1:lfs.0 Request processed in 14340us (14638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864795.979267:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:0.0:1787864795.988589:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864795.988885:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930752 00000100:00100000:3.0:1787864795.988925:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930752 00000100:00100000:2.0:1787864795.989169:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:2.0:1787864795.989183:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548b6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+42:11380:x1874711825930752:12345-192.168.206.36@tcp:35:lfs.0 00000004:00010000:2.0:1787864795.989264:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca7b expref: 42 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864795.989565:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787864795.989598:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787864795.990048:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1787864795.990092:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.990113:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.990123:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.990167:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.990183:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 46 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864795.990199:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1874711844874624:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864795.990321:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b540 going to sleep for 11 seconds 00000040:00080000:1.0:1787864795.993163:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864795.993176:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864795.993200:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787864795.993209:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787864795.994191:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864795.994348:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1874711844874624:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864795.994386:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.994705:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825930880 00000100:00100000:1.0:1787864795.994714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825930880 00010000:00010000:1.0:1787864795.994759:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 47 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864795.994812:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:1.0:1787864795.994824:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+47:2410:x1874711825930880:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864795.994859:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864795.994867:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 47 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.994881:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 47 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.994946:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43a45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca58 expref: 47 pid: 6511 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.994973:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:1.0:1787864795.994978:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.994988:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.994996:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864795.995354:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864795.995418:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+46:2410:x1874711825930880:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 596us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.995427:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 69 00010000:00010000:2.0:1787864795.995758:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864795.995769:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864795.995954:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1787864795.996878:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787864795.997492:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844874752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864795.997576:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864795.997626:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff927554d55780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864795.998502:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844874752 00000100:00100000:1.0:1787864795.998515:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844874752 00000100:00100000:1.0:1787864795.998595:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787864795.998606:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844874752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787864795.998742:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844874752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 138us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864795.998766:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787864795.999331:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844874752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787864795.999514:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1787864796.000421:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844874880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864796.000491:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864796.000526:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864796.001643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844874880 00000100:00100000:0.0:1787864796.001655:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844874880 00000100:00100000:0.0:1787864796.001744:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787864796.002045:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844874880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864796.002282:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6513:x1874711844874880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 242us (1790us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787864796.002365:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cf00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844874880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787864796.002388:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000001:00080000:2.0:1787864796.002449:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1787864796.002497:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002507:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002515:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002522:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864796.002527:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002535:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002574:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:2.0:1787864796.002578:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787864796.002583:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.002590:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aa0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864796.002716:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787864796.002800:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787864796.002814:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 321064924268ns, next at 322064921646ns, rc = 0 00000001:00080000:2.0:1787864796.002822:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1787864796.002846:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927548558c00) 00010000:00010000:2.0:1787864796.002849:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787864796.002857:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43a8b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca7b expref: 50 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.004231:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548b6a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+49:11380:x1874711825930752:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 13828us (14434us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787864796.004246:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 26 00000020:00080000:2.0:1787864796.004255:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787864796.007822:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.009985:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825931008 00000100:00100000:1.0:1787864796.010004:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825931008 00000100:00100000:1.0:1787864796.010203:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 111 00000100:00100000:1.0:1787864796.010217:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+49:11380:x1874711825931008:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864796.010247:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864796.010275:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc43aa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca82 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.010349:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc43aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca82 expref: 50 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.010366:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc43aa7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca82 expref: 50 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.010387:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.010390:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864796.010395:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949400, rc 0) 00000100:00080000:0.0:1787864796.010511:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864796.012043:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+50:11380:x1874711825931008:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1819us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864796.012068:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 111 00000100:00100000:3.0:1787864796.020859:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864796.021004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825931264 00000100:00100000:0.0:1787864796.021015:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825931264 00000100:00100000:0.0:1787864796.021105:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:0.0:1787864796.021122:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+50:11380:x1874711825931264:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864796.021432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+51:11380:x1874711825931264:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 315us (586us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787864796.021441:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:0.0:1787864796.087749:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.087846:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825931392 00000100:00100000:2.0:1787864796.087859:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825931392 00000100:00100000:0.0:1787864796.088057:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 112 00000100:00100000:0.0:1787864796.088070:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+51:11390:x1874711825931392:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:0.0:1787864796.088187:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088209:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088222:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088234:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088242:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088249:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088405:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088415:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088423:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864796.088620:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088637:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088656:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088663:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088671:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864796.088676:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088685:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088699:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864796.088703:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864796.088708:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088714:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43aae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088730:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088736:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088742:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088747:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864796.088756:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088763:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088770:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:0.0:1787864796.088773:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864796.088776:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088783:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ab5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088803:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088810:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088816:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088822:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864796.088825:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088831:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088839:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864796.088841:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864796.088852:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.088858:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43abc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864796.089085:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+51:11390:x1874711825931392:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 1015us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864796.089096:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 112 00000100:00100000:1.0:1787864796.125081:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864796.125298:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825931648 00000100:00100000:0.0:1787864796.125310:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825931648 00000100:00100000:0.0:1787864796.125388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:0.0:1787864796.125400:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+51:11393:x1874711825931648:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864796.125428:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864796.125456:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ac3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca89 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125548:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125565:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125579:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125592:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125600:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125625:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125776:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125786:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.125805:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864796.125819:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787864796.126259:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126269:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126276:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126282:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864796.126287:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126296:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126310:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864796.126313:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864796.126329:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126336:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43aca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126353:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126360:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126367:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126373:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864796.126376:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126381:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126390:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:0.0:1787864796.126392:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864796.126395:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126401:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43ad1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126447:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ac3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126474:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 53 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.126481:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864796.126484:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864796.126487:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba600, rc 0) 00000100:00100000:0.0:1787864796.126579:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11393:x1874711825931648:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1181us (1512us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787864796.126588:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:1.0:1787864796.131238:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.131389:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825931776 00000100:00100000:2.0:1787864796.131401:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825931776 00000100:00100000:2.0:1787864796.131493:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 114 00000100:00100000:2.0:1787864796.131502:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11393:x1874711825931776:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864796.131578:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131618:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131633:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131690:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131698:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131705:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131711:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864796.131716:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131725:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131739:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864796.131743:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864796.131759:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.131767:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.131863:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11393:x1874711825931776:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 361us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.131879:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 114 00000100:00100000:3.0:1787864796.133748:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.133836:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932032 00000100:00100000:1.0:1787864796.133846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932032 00000100:00100000:1.0:1787864796.134001:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:1.0:1787864796.134012:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+53:11393:x1874711825932032:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:1.0:1787864796.134330:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11393:x1874711825932032:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 318us (593us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787864796.134340:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:1.0:1787864796.200146:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.200707:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932288 00000100:00100000:2.0:1787864796.200720:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932288 00000100:00100000:2.0:1787864796.200811:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 115 00000100:00100000:2.0:1787864796.200824:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11403:x1874711825932288:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864796.200865:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864796.200869:0:13804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864796.200948:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43a68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca6d expref: 54 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.200982:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864796.200988:0:13804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864796.201005:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aed lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca90 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.201132:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.201148:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.201157:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.201197:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.201214:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 54 pid: 6512 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.201249:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844875008:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864796.202224:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864796.204567:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844875008:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864796.204608:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864796.205291:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.205573:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932416 00000100:00100000:2.0:1787864796.205583:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932416 00010000:00010000:2.0:1787864796.205634:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 55 pid: 6512 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.205679:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 70 00000100:00100000:2.0:1787864796.205690:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+55:2410:x1874711825932416:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864796.205729:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864796.205737:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 55 pid: 6512 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205751:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 55 pid: 6512 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205779:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43ad8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca89 expref: 55 pid: 6512 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205807:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864796.205812:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205823:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205853:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.205910:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864796.205989:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:2410:x1874711825932416:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 300us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.205996:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 70 00010000:00010000:1.0:1787864796.206394:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.206404:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864796.206426:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787864796.206584:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43aed lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 55 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.206601:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 54 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.206610:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.206613:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787864796.206616:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:1.0:1787864796.206666:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11403:x1874711825932288:12345-192.168.206.36@tcp:101:bash.0 Request processed in 5845us (6534us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787864796.206674:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 115 00000100:00100000:1.0:1787864796.211365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864796.211455:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932544 00000100:00100000:3.0:1787864796.211467:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932544 00000100:00100000:3.0:1787864796.211527:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:3.0:1787864796.211536:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+54:11403:x1874711825932544:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864796.211566:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864796.211592:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43b02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca97 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211637:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211653:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211666:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211813:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43b02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 56 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211834:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 55 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.211855:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864796.211859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864796.211863:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e800, rc 0) 00000100:00100000:3.0:1787864796.211968:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+55:11403:x1874711825932544:12345-192.168.206.36@tcp:101:bash.0 Request processed in 431us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.211975:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:3.0:1787864796.216539:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.216710:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932800 00000100:00100000:1.0:1787864796.216722:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932800 00000100:00100000:1.0:1787864796.216806:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 117 00000100:00100000:1.0:1787864796.216817:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+55:11403:x1874711825932800:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:1.0:1787864796.217149:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.217171:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.217184:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864796.217230:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1787864796.217253:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba319121 reply state 000000008b737110 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.217267:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.217275:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.217278:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787864796.217283:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864796.217387:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11403:x1874711825932800:12345-192.168.206.36@tcp:36:bash.0 Request processed in 571us (861us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787864796.217395:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 117 00000020:00080000:1.0:1787864796.217400:0:10168:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787864796.221168:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864796.221277:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825932928 00000100:00100000:0.0:1787864796.221289:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825932928 00000100:00100000:0.0:1787864796.221376:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 118 00000100:00100000:0.0:1787864796.221387:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11403:x1874711825932928:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864796.221417:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864796.221442:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43b17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aca9e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.221559:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.221577:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 59 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.221587:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.221660:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 59 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864796.221683:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 59 pid: 13804 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864796.221699:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844875136:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864796.221813:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864796.224609:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844875136:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864796.224645:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.225938:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.226284:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933056 00000100:00100000:1.0:1787864796.226295:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933056 00010000:00010000:1.0:1787864796.226357:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 60 pid: 13804 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864796.226419:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:1.0:1787864796.226430:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+60:2409:x1874711825933056:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864796.226447:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864796.226455:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 60 pid: 13804 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226468:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 60 pid: 13804 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226501:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43af4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca90 expref: 60 pid: 13804 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226519:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.226524:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226536:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226544:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.226879:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864796.227010:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+59:2409:x1874711825933056:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 579us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864796.227020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 71 00010000:00010000:3.0:1787864796.227561:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.227573:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864796.227646:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787864796.227652:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864796.227692:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.227961:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43b17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.227985:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.228014:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864796.228017:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864796.228021:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:3.0:1787864796.228180:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11403:x1874711825932928:12345-192.168.206.36@tcp:101:bash.0 Request processed in 6793us (7023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.228189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 118 00000100:00100000:2.0:1787864796.231514:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864796.231618:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933312 00000100:00100000:0.0:1787864796.231630:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933312 00000100:00100000:0.0:1787864796.231847:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:0.0:1787864796.231860:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+58:11403:x1874711825933312:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:0.0:1787864796.232307:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11403:x1874711825933312:12345-192.168.206.36@tcp:35:bash.0 Request processed in 448us (803us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787864796.232317:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:0.0:1787864796.278937:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864796.279082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933440 00000100:00100000:3.0:1787864796.279094:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933440 00000100:00100000:3.0:1787864796.279166:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 119 00000100:00100000:3.0:1787864796.279177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:11409:x1874711825933440:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864796.279206:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864796.279232:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43b25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaa5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279312:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279328:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279340:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864796.279391:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1787864796.279395:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864796.279417:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279468:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43b25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaa5 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279488:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaa5 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.279503:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864796.279505:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864796.279510:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ee00, rc 0) 00000100:00100000:3.0:1787864796.279589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825933440:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 413us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.279597:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 119 00000100:00100000:3.0:1787864796.282070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.282243:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933568 00000100:00100000:1.0:1787864796.282269:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933568 00000100:00100000:1.0:1787864796.282339:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 120 00000100:00100000:1.0:1787864796.282350:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825933568:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864796.282375:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864796.282399:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaac expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282475:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282492:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282505:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282517:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282526:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282532:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282619:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282630:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282638:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864796.282694:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787864796.282711:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864796.282733:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282747:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282757:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282764:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282772:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282779:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864796.282784:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282804:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282818:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:1.0:1787864796.282822:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864796.282828:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282835:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282872:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282879:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282885:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282925:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864796.282929:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282937:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282945:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:1.0:1787864796.282948:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864796.282952:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282958:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282985:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaac expref: 62 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.282999:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaac expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.283017:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.283020:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864796.283022:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948400, rc 0) 00000100:00100000:1.0:1787864796.283100:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11409:x1874711825933568:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 751us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864796.283108:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 120 00000100:00100000:2.0:1787864796.293007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864796.293087:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933696 00000100:00100000:3.0:1787864796.293099:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933696 00000100:00100000:2.0:1787864796.293133:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864796.293193:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:3.0:1787864796.293205:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+61:2409:x1874711825933696:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864796.293222:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864796.293247:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43b48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaac expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.293267:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864796.293272:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864796.293335:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:2409:x1874711825933696:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.293343:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:1.0:1787864796.295261:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825933952 00000100:00100000:1.0:1787864796.295278:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825933952 00000100:00100000:1.0:1787864796.295417:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:1.0:1787864796.295428:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825933952:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864796.295452:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864796.295475:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acab3 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.295607:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.295623:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.295632:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.295673:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.295687:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 61 pid: 6510 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864796.295721:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b32580 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844875264:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864796.296053:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864796.299621:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b32580 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844875264:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864796.299650:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864796.301066:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864796.301377:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934080 00000100:00100000:1.0:1787864796.301388:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934080 00010000:00010000:1.0:1787864796.301436:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 62 pid: 6510 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864796.301548:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 72 00000100:00100000:1.0:1787864796.301560:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+62:2410:x1874711825934080:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864796.301579:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864796.301594:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 62 pid: 6510 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301609:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 62 pid: 6510 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301638:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca9e expref: 62 pid: 6510 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301658:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864796.301663:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301701:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301710:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864796.301747:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864796.301832:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:2410:x1874711825934080:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 274us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864796.301841:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 72 00010000:00010000:2.0:1787864796.301941:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.301952:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864796.301987:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787864796.302156:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 62 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.302178:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 61 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.302186:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864796.302189:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864796.302202:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949000, rc 0) 00000100:00100000:2.0:1787864796.302250:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11409:x1874711825933952:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 6823us (9117us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787864796.302262:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:2.0:1787864796.309883:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864796.309990:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934336 00000100:00100000:3.0:1787864796.310007:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934336 00000100:00100000:3.0:1787864796.310155:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:3.0:1787864796.310169:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11409:x1874711825934336:12345-192.168.206.36@tcp:103:lfs.0 00010000:00010000:3.0:1787864796.310189:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864796.310220:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc43aa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca82 expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864796.310244:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864796.310250:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864796.310347:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825934336:12345-192.168.206.36@tcp:103:lfs.0 Request processed in 182us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.310355:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:3.0:1787864796.313113:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.313235:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934464 00000100:00100000:2.0:1787864796.313248:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934464 00000100:00100000:2.0:1787864796.313334:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:2.0:1787864796.313346:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825934464:12345-192.168.206.36@tcp:58:lfs.0 00010000:00010000:2.0:1787864796.313482:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.313504:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.313517:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864796.313634:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787864796.314461:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825934464:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 1112us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.314472:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:3.0:1787864796.316311:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864796.316391:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934592 00000100:00100000:2.0:1787864796.316401:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934592 00000100:00100000:2.0:1787864796.316463:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 123 00000100:00100000:2.0:1787864796.316473:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+60:11409:x1874711825934592:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864796.316497:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864796.316523:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaba expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316616:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316627:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316651:0:10168:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316679:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316696:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864796.316699:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864796.316703:0:10168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 61 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864796.316712:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030e00, rc 0) 00000100:00100000:2.0:1787864796.316784:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11409:x1874711825934592:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 312us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.316803:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 123 00000100:00100000:2.0:1787864796.441239:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864796.442389:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844875392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864796.442492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864796.443195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844875392 00000100:00100000:3.0:1787864796.443207:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844875392 00000100:00100000:3.0:1787864796.443658:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787864796.443672:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844875392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864796.443924:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787864796.444023:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844875392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 354us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864796.444031:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864796.444079:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844875392:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864796.506082:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864796.953504:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844875520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864796.953598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864796.953758:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844875520 00000100:00100000:2.0:1787864796.953798:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844875520 00000100:00100000:2.0:1787864796.953865:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787864796.953876:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844875520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864796.953929:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864796.953987:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844875520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.953995:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787864796.954047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844875520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864796.954258:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927547a292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844875648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864796.954312:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864796.954448:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844875648 00000100:00100000:2.0:1787864796.954453:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844875648 00000100:00100000:2.0:1787864796.954490:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787864796.954498:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3640:x1874711844875648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864796.954522:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864796.954564:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3640:x1874711844875648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864796.954570:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787864796.954760:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927547a292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844875648:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787864797.018742:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864797.018756:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864797.019205:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787864797.019221:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864797.019570:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b31e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844875776:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864797.020551:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864797.030569:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.030631:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b31e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844875776:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864797.035009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934720 00000100:00100000:3.0:1787864797.035023:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934720 00000100:00100000:3.0:1787864797.035093:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 124 00000100:00100000:3.0:1787864797.035102:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11410:x1874711825934720:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787864797.035158:0:6510:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787864797.035336:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11410:x1874711825934720:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 234us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864797.035345:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 124 00000100:00100000:2.0:1787864797.041806:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.041974:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825934848 00000100:00100000:0.0:1787864797.041983:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825934848 00000100:00100000:0.0:1787864797.042039:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 125 00000100:00100000:0.0:1787864797.042048:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11410:x1874711825934848:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787864797.042114:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042130:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042153:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042168:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042174:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042180:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042202:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042211:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042217:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864797.042259:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787864797.042263:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864797.042276:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042286:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042292:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042309:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042315:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbc00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864797.042318:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042325:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042335:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:0.0:1787864797.042338:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864797.042342:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042348:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43b72 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042359:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042366:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042371:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042375:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864797.042377:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042390:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042398:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff927548d9cd00) 00010000:00010000:0.0:1787864797.042399:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864797.042402:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042407:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43b79 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042418:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042423:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042428:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042432:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bac00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864797.042434:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042439:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042444:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864797.042446:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864797.042448:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.042460:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.042526:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11410:x1874711825934848:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 Request processed in 478us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.042533:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 125 00000100:00100000:2.0:1787864797.045449:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.047668:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825935104 00000100:00100000:1.0:1787864797.047681:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825935104 00000100:00100000:1.0:1787864797.047952:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 126 00000100:00100000:1.0:1787864797.047963:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+61:11410:x1874711825935104:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864797.047983:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864797.048015:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acac1 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048114:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048129:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048139:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864797.048151:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787864797.048219:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048226:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048233:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048238:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864797.048242:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048249:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048260:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864797.048263:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787864797.048267:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048283:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43b8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048322:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b87 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acac1 expref: 63 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048332:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864797.048335:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864797.048339:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43b87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acac1 expref: 63 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.048348:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949e00, rc 0) 00000100:00100000:1.0:1787864797.048404:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935104:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 443us (2961us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1787864797.048411:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 126 00000100:00100000:1.0:1787864797.052140:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.052215:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825935232 00000100:00100000:2.0:1787864797.052223:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825935232 00000100:00100000:2.0:1787864797.052275:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 127 00000100:00100000:2.0:1787864797.052284:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935232:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864797.052316:0:13804:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864797.052422:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935232:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 139us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.052430:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 127 00000100:00100000:2.0:1787864797.060172:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.061326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825935488 00000100:00100000:0.0:1787864797.061338:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825935488 00000100:00100000:0.0:1787864797.061400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 128 00000100:00100000:0.0:1787864797.061412:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935488:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864797.061430:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864797.061434:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787864797.061458:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc43b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaa5 expref: 62 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.061477:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864797.061482:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864797.061495:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acac8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864797.062105:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787864797.062503:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ba3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.062518:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.062529:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.062594:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43b9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acac8 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.062611:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acac8 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.062618:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927548d9cd00) 00010000:00010000:0.0:1787864797.062621:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864797.062623:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:0.0:1787864797.062883:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11410:x1874711825935488:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1471us (2717us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787864797.062917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 128 00000100:00100000:0.0:1787864797.076678:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.076933:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825935744 00000100:00100000:2.0:1787864797.076941:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825935744 00000100:00100000:2.0:1787864797.077006:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:2.0:1787864797.077016:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11410:x1874711825935744:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.077067:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864797.077091:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ba3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acac8 expref: 63 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077109:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927548d9cd00) 00010000:00010000:2.0:1787864797.077120:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864797.077140:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077153:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077163:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077178:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077200:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077208:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077249:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077272:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077279:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077284:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.077288:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077296:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077316:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:2.0:1787864797.077319:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.077323:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077329:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077344:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077350:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077355:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077360:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.077368:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077374:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077382:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x74a60378 (ffff927448159100) 00010000:00010000:2.0:1787864797.077384:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.077387:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.077393:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bb8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x74a60378 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.077470:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935744:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 455us (800us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864797.077477:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:1.0:1787864797.080261:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.080346:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825935872 00000100:00100000:2.0:1787864797.080354:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825935872 00000100:00100000:2.0:1787864797.080407:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00100000:2.0:1787864797.080417:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+62:11410:x1874711825935872:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.080434:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864797.080454:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43bbf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acacf expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080485:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080497:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080522:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080617:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43bbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 64 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080632:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 63 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.080640:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.080643:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864797.080647:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030800, rc 0) 00000100:00100000:2.0:1787864797.080703:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11410:x1874711825935872:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 287us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.080710:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00100000:3.0:1787864797.085217:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.085308:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825936128 00000100:00100000:2.0:1787864797.085317:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825936128 00000100:00100000:2.0:1787864797.085373:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:2.0:1787864797.085383:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+63:11410:x1874711825936128:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.085455:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.085471:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.085481:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864797.085642:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1787864797.085652:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322147762136ns, next at 323147759716ns, rc = 0 00000004:00010000:2.0:1787864797.085695:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a555cf20 reply state 00000000a23b1a9e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.085707:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.085715:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.085719:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787864797.085722:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864797.086829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11410:x1874711825936128:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 1442us (1615us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787864797.086838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:0.0:1787864797.090398:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.090494:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825936256 00000100:00100000:2.0:1787864797.090503:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825936256 00000100:00100000:2.0:1787864797.090603:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:2.0:1787864797.090613:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+65:11410:x1874711825936256:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.090633:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864797.090664:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acad6 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.090715:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 66 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.090729:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 66 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.090764:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.090780:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864797.090791:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031600, rc 0) 00000100:00100000:2.0:1787864797.090848:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11410:x1874711825936256:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 236us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.090854:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:3.0:1787864797.093690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.093804:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825936384 00000100:00100000:0.0:1787864797.093812:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825936384 00000100:00100000:0.0:1787864797.093880:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:0.0:1787864797.093918:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825936384:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787864797.094126:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2410:x1874711825936384:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 210us (443us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787864797.094135:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00080000:3.0:1787864797.094294:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864797.097236:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.097295:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825936640 00000100:00100000:1.0:1787864797.097303:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825936640 00000100:00100000:1.0:1787864797.097357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:1.0:1787864797.097367:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+66:11410:x1874711825936640:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787864797.097562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+67:11410:x1874711825936640:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 196us (332us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787864797.097570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:2.0:1787864797.100693:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.100817:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825936896 00000100:00100000:1.0:1787864797.100826:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825936896 00000100:00100000:3.0:1787864797.101490:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 133 00000100:00100000:3.0:1787864797.101505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+67:11410:x1874711825936896:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787864797.101605:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+67:11410:x1874711825936896:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 104us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864797.101612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 133 00000100:00100000:3.0:1787864797.104736:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.104923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937024 00000100:00100000:0.0:1787864797.104931:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937024 00000100:00100000:0.0:1787864797.106643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 134 00000100:00100000:0.0:1787864797.106663:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+67:11410:x1874711825937024:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864797.106699:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864797.106721:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43bdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acadd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109017:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109039:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109050:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864797.109093:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864797.109113:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109145:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43bdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acadd expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109163:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acadd expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.109172:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:0.0:1787864797.109175:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787864797.109178:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba200, rc 0) 00000100:00100000:0.0:1787864797.109251:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+68:11410:x1874711825937024:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 2596us (4522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.109260:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 134 00000100:00100000:2.0:1787864797.124278:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.124431:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937152 00000100:00100000:0.0:1787864797.124439:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937152 00000100:00100000:0.0:1787864797.124532:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:0.0:1787864797.124544:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825937152:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864797.124563:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864797.124581:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acae4 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864797.124607:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a6dc, blocks: 0x0 00010000:00010000:0.0:1787864797.124626:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1787864797.124631:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864797.124640:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.124661:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 10 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.124674:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864797.124737:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2409:x1874711825937152:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 196us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.124744:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:2.0:1787864797.131209:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.131450:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937408 00000100:00100000:1.0:1787864797.131458:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937408 00000100:00100000:1.0:1787864797.131516:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 135 00000100:00100000:1.0:1787864797.131526:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+68:11410:x1874711825937408:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864797.131637:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+68:11410:x1874711825937408:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 112us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.131645:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 135 00000100:00100000:3.0:1787864797.136014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.136398:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937536 00000100:00100000:0.0:1787864797.136407:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937536 00000100:00100000:0.0:1787864797.136472:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:0.0:1787864797.136483:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+10:11410:x1874711825937536:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864797.136501:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864797.136533:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaeb expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.136566:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.136575:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864797.136579:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864797.136583:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.136629:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.136643:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 11 pid: 8423 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.136656:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844875904:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864797.136758:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864797.141058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.141220:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937664 00000100:00100000:1.0:1787864797.141228:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937664 00010000:00010000:1.0:1787864797.141266:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 12 pid: 8423 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.141317:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:1.0:1787864797.141327:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+12:2410:x1874711825937664:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.141341:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.141362:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 12 pid: 8423 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.141375:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 12 pid: 8423 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.141398:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864797.141402:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864797.141411:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.141439:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.141474:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 12 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.141489:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b30f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1874711844876032:192.168.206.36@tcp:105: 00000100:00100000:1.0:1787864797.141565:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set ffff927549ca9180 going to sleep for 11 seconds 00010000:00010000:0.0:1787864797.141935:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9887546/0x2fcb8c294dc43be9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acae4 expref: 12 pid: 8423 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.141950:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844875904:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864797.141972:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.142059:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbc00, rc 0) 00000100:00100000:0.0:1787864797.142086:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:11410:x1874711825937536:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 5606us (6080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.142094:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:1.0:1787864797.146155:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b30f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6496:1874711844876032:192.168.206.36@tcp:105: 00010000:00010000:1.0:1787864797.146179:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864797.146236:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2410:x1874711825937664:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 4910us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.146247:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 73 00000100:00100000:3.0:1787864797.150346:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.150510:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937792 00000100:00100000:1.0:1787864797.150519:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937792 00002000:00100000:1.0:1787864797.150566:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff927448af7c00 x1874711825937792/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:648/0 lens 504/0 e 0 to 0 dl 1787864808 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787864797.150577:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448af7c00 with x1874711825937792 ext(0->12) 00002000:00010000:1.0:1787864797.150582:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448af7c00 00000100:00100000:1.0:1787864797.150619:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:1.0:1787864797.150629:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2410:x1874711825937792:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787864797.151928:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+12:2410:x1874711825937792:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 Request processed in 1295us (1585us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787864797.152117:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00002000:00100000:1.0:1787864797.152128:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff927448af7c00 x1874711825937792/t4294967309(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:648/0 lens 504/448 e 0 to 0 dl 1787864808 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787864797.152137:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448af7c00 with x1874711825937792 ext(0->12) 00002000:00010000:1.0:1787864797.152141:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448af7c00 00000100:00100000:3.0:1787864797.155856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.156171:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825937920 00000100:00100000:0.0:1787864797.156180:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825937920 00000100:00100000:0.0:1787864797.156241:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 136 00000100:00100000:0.0:1787864797.156251:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+68:11410:x1874711825937920:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787864797.161934:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1787864797.161963:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1787864797.162013:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1787864797.162038:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92757daa8600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787864797.162043:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc2a300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92757daa8540 00000020:00080000:1.0:1787864797.162047:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc2a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff927545765600 00000004:00080000:1.0:1787864797.162093:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787864797.162125:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92757dc01d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787864797.162128:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92754cd5c100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92757dc010c0 00000020:00080000:1.0:1787864797.162132:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92754cd5ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92757dd1a000 00000020:00080000:1.0:1787864797.162146:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1787864797.162298:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162312:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162321:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162328:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbe00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162335:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162344:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.162366:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11410:x1874711825937920:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 Request processed in 6108us (6510us total) trans 0 rc 0/0 00010000:00010000:2.0:1787864797.162367:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff927448159300) 00010000:00010000:2.0:1787864797.162376:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.162385:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.162391:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 136 00010000:00010000:2.0:1787864797.162414:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc438f5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162451:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162457:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162463:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162468:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162471:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162477:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162485:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff927548d9c900) 00010000:00010000:2.0:1787864797.162488:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.162491:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162496:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc4399d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162511:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162518:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162531:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162542:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162547:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162553:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162564:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:2.0:1787864797.162567:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.162571:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162577:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43a1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162591:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162600:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162607:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162614:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162619:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162637:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787864797.162647:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:2.0:1787864797.162650:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927448159b00) 00010000:00010000:2.0:1787864797.162656:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.162659:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162665:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43a3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162685:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162692:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162697:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162703:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162706:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162712:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787864797.162716:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:2.0:1787864797.162723:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864797.162728:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864797.162731:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787864797.162732:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864797.162751:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844876416:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787864797.162755:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43b10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162774:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162780:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162802:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162808:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.162811:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162818:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864797.162824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864797.162838:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.162841:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864797.162845:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.162852:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43bcd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864797.162884:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844876416 00000100:00100000:3.0:1787864797.162926:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844876416 00000100:00100000:2.0:1787864797.162987:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844876288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787864797.163055:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864797.163063:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787864797.163091:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844876416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787864797.163094:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864797.163113:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844876160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787864797.163145:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864797.163184:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844876288 00000100:00100000:2.0:1787864797.163190:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844876288 00002000:00010000:3.0:1787864797.163195:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787864797.163200:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787864796 00002000:00010000:3.0:1787864797.163202:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787864797.163205:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787864796 -> 1787864796 00002000:00010000:3.0:1787864797.163207:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787864797.163235:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844876160 00000100:00100000:2.0:1787864797.163242:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844876160 00000100:00100000:3.0:1787864797.163266:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3640:x1874711844876416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (446us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787864797.163273:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787864797.163287:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864797.163289:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1874711844876288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787864797.163318:0:8820:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1787864797.163344:0:8820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.163369:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864797.163377:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787864797.163391:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00000100:00100000:3.0:1787864797.163400:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3638:x1874711844876160:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787864797.163402:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864797.163415:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787864797.163425:0:8425:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1787864797.163453:0:8425:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a90a6db, atime: 0x6a90a6db, ctime: 0x6a90a6db, blocks: 0x8 00010000:00010000:2.0:1787864797.163458:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 11 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163463:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163483:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1787864797.163484:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 11 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163492:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864797.163508:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.163517:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844876544:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864797.163532:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163545:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163567:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163590:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864797.163693:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3638:x1874711844876160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 299us (546us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787864797.163699:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1787864797.163718:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864797.163724:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163732:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864797.163736:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163744:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163758:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163765:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc43bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.163796:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864797.163803:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864797.163805:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864797.163813:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864797.163816:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864797.163823:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b240 going to sleep for 11 seconds 00000004:00080000:3.0:1787864797.163854:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff927448af43c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787864797.163863:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844876416:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1787864797.163874:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff927448b552c0/2, rc 0, transno 4294967305 00000100:00100000:2.0:1787864797.163883:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844876160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864797.167865:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.168006:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938048 00000100:00100000:1.0:1787864797.168016:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938048 00010000:00010000:1.0:1787864797.168078:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 12 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.168137:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 74 00000100:00100000:1.0:1787864797.168150:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+12:2409:x1874711825938048:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.168171:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.168196:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 12 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.168213:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 12 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.168246:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864797.168251:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864797.168258:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.168270:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.168295:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864797.168364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+12:2409:x1874711825938048:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 218us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.168373:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 74 00010000:00010000:2.0:1787864797.168743:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ec801ef/0x2fcb8c294dc439ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca43 expref: 11 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.168762:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844876544:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864797.168798:0:8820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.168811:0:8820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.168819:0:8820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.168831:0:8820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.168840:0:8820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.168866:0:8820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787864797.168922:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864797.168937:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.168951:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864797.168956:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.168968:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.169064:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.169094:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc43bf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.169121:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864797.169123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864797.169124:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864797.171780:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3638:x1874711844876288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8480us (8710us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787864797.171841:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1787864797.171842:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff927448af4b40/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787864797.171860:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844876288:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787864797.172259:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.172330:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938176 00000100:00100000:0.0:1787864797.172339:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938176 00000100:00100000:0.0:1787864797.172408:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:0.0:1787864797.172420:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2408:x1874711825938176:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787864797.178141:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787864797.178161:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1787864797.183815:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825938176:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 Request processed in 11381us (11543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.183833:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:3.0:1787864797.189341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.189437:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938432 00000100:00100000:2.0:1787864797.189454:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938432 00000100:00100000:2.0:1787864797.189546:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 137 00000100:00100000:2.0:1787864797.189559:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11410:x1874711825938432:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.189623:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864797.189655:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43be2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acadd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.189679:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.189685:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864797.189720:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.189736:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.189747:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864797.189965:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018443309 reply state 00000000bcbc07c1 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.189980:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.189988:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.190007:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864797.190011:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864797.190402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+17:11410:x1874711825938432:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 839us (1064us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1787864797.190412:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 137 00000100:00100000:3.0:1787864797.193491:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.193802:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938560 00000100:00100000:2.0:1787864797.193817:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938560 00000100:00100000:2.0:1787864797.194373:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:2.0:1787864797.194389:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825938560:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787864797.194603:0:8426:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787864797.194607:0:8426:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1787864796 -> 1787864796 00002000:00010000:2.0:1787864797.194692:0:8426:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787864795 00002000:00010000:2.0:1787864797.194695:0:8426:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1787864796 -> 1787864796 00002000:00010000:2.0:1787864797.194697:0:8426:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787864797.195088:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825938560:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 702us (1603us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787864797.195098:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:1.0:1787864797.198745:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.198837:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938816 00000100:00100000:2.0:1787864797.198854:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938816 00000100:00100000:2.0:1787864797.198965:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 138 00000100:00100000:2.0:1787864797.198977:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+17:11410:x1874711825938816:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.199073:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.199094:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 17 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.199105:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.199270:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 17 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.199301:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 17 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.199318:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844876672:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864797.199419:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864797.209987:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.210101:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844876672:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864797.210136:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.210190:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825938944 00000100:00100000:1.0:1787864797.210203:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825938944 00010000:00010000:1.0:1787864797.210247:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 18 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.210289:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 75 00000100:00100000:1.0:1787864797.210311:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+18:2409:x1874711825938944:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.210326:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.210333:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 18 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210347:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 18 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210368:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43bc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acacf expref: 18 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210384:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:1.0:1787864797.210389:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210398:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210405:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.210431:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864797.210473:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.210488:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+17:2409:x1874711825938944:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 177us (657us total) trans 0 rc 0/0 00010000:00010000:2.0:1787864797.210492:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.210503:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 75 00010000:00010000:2.0:1787864797.210554:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210564:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210573:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210581:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.210586:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210612:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210628:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.210632:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787864797.210637:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.210644:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c0c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.210712:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11410:x1874711825938816:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 Request processed in 11735us (11973us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787864797.210723:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 138 00000100:00100000:3.0:1787864797.213871:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.215147:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939072 00000100:00100000:2.0:1787864797.215164:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939072 00000100:00100000:2.0:1787864797.215245:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:2.0:1787864797.215257:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825939072:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.215311:0:8820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.215336:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.215346:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864797.215351:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864797.215357:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.215417:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 7 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.215434:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 7 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.215452:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844876800:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864797.215605:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864797.231722:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.231735:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844876800:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864797.231775:0:8820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.232527:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939200 00000100:00100000:1.0:1787864797.232539:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939200 00010000:00010000:1.0:1787864797.232584:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 8 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.232649:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:1.0:1787864797.232660:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825939200:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.232677:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.232700:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 8 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.232718:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 8 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.232741:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc43bf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaeb expref: 8 pid: 8426 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.232758:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864797.232762:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864797.232768:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.232778:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.232820:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864797.232866:0:8820:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.232883:0:8820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.232947:0:8820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.232957:0:8820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.232991:0:8820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.232999:0:8820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864797.233004:0:8820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.233014:0:8820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.233032:0:8820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.233041:0:8820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009abe6007/0x2fcb8c294dc43c13 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.233258:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825939200:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 597us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.233277:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:2.0:1787864797.233701:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825939072:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 Request processed in 18441us (19836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.233715:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:3.0:1787864797.238430:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.238555:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939456 00000100:00100000:2.0:1787864797.238570:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939456 00000100:00100000:2.0:1787864797.238653:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 139 00000100:00100000:2.0:1787864797.238666:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+16:11410:x1874711825939456:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787864797.238804:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.238831:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.238849:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.238936:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.238956:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 16 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.238974:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844876928:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864797.239082:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864797.242797:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.242815:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844876928:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864797.242852:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.246148:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939584 00000100:00100000:1.0:1787864797.246162:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939584 00010000:00010000:1.0:1787864797.246225:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 17 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.246431:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 77 00000100:00100000:1.0:1787864797.246443:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+17:2410:x1874711825939584:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.246460:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.246467:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 17 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246482:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 17 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246505:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca97 expref: 17 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246523:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:1.0:1787864797.246528:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 16 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246539:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246546:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246554:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.246599:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864797.246677:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+16:2410:x1874711825939584:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 236us (3898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.246685:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 77 00010000:00010000:0.0:1787864797.246774:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.246793:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.247025:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.247038:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 16 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.247046:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.247085:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 16 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.247099:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 16 pid: 8448 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.247112:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844877056:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864797.247170:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787864797.250294:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844877056:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864797.250322:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.252173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.252562:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939712 00000100:00100000:1.0:1787864797.252571:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939712 00010000:00010000:1.0:1787864797.252624:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 17 pid: 8448 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.252665:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 78 00000100:00100000:1.0:1787864797.252674:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+17:2409:x1874711825939712:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864797.252689:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864797.252696:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 17 pid: 8448 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252708:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 17 pid: 8448 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252729:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43bd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acad6 expref: 17 pid: 8448 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252745:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:1.0:1787864797.252751:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252760:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252794:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864797.252825:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864797.252878:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+16:2409:x1874711825939712:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 204us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.252885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 78 00010000:00010000:2.0:1787864797.253175:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.253193:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864797.253493:0:13804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787864797.253644:0:13804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787864797.253685:0:13804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787864797.253820:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13804:1874711844877184:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787864797.254617:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864797.254673:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927554d55780 going to sleep for 11 seconds 00000100:00100000:0.0:1787864797.254715:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844877184 00000100:00100000:0.0:1787864797.254726:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844877184 00000100:00100000:0.0:1787864797.254792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787864797.254802:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13804:x1874711844877184:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787864797.255018:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:13804:x1874711844877184:12345-0@lo:1000:mdt00_005.0 Request processed in 217us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.255025:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787864797.255607:0:13804:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787864797.255617:0:13804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1787864797.255642:0:13804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff927448af43c0, transno 4294967310 00000004:00080000:2.0:1787864797.255660:0:13804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff927448af4b40, transno 4294967311 00000100:00100000:2.0:1787864797.255670:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13804:1874711844877184:0@lo:1000:mdt00_005.0 00000001:00080000:2.0:1787864797.255886:0:13804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1787864797.255989:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13804:1874711844877312:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787864797.256043:0:13804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864797.256069:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864797.256104:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844877312 00000100:00100000:3.0:1787864797.256114:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844877312 00000100:00100000:3.0:1787864797.256158:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787864797.256167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13804:x1874711844877312:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787864797.256506:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13804:x1874711844877312:12345-0@lo:1000:mdt00_005.0 Request processed in 340us (462us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787864797.256514:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787864797.265698:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:13804:1874711844877312:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787864797.265758:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265769:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265776:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265791:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.265797:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265804:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265820:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.265837:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864797.265843:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265849:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43c21 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265874:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265880:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265901:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265907:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.265910:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265916:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265925:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864797.265927:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864797.265933:0:13804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.265944:0:13804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.266021:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.266066:0:13804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 19 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.266081:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844877440:192.168.206.36@tcp:105: 00000100:00100000:2.0:1787864797.266163:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927554d55780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864797.270258:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94f00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844877440:192.168.206.36@tcp:105: 00010000:00010000:2.0:1787864797.270298:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270309:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43b64 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270339:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270354:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270365:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270376:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270383:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270390:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270413:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.270418:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270425:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270437:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864797.270440:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864797.270444:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270450:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43c28 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270460:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270466:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270472:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270478:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864797.270481:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270486:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270504:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864797.270506:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864797.270509:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.270514:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43c1a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.270678:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11410:x1874711825939456:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 32013us (32254us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787864797.270688:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 139 00000020:00080000:2.0:1787864797.270695:0:13804:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787864797.270876:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864797.270881:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864797.271428:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787864797.271437:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864797.275007:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.275241:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825939840 00000100:00100000:0.0:1787864797.275249:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825939840 00000100:00100000:0.0:1787864797.275313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:0.0:1787864797.275323:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11409:x1874711825939840:12345-192.168.206.36@tcp:49:lfs.0 00000100:00100000:0.0:1787864797.275450:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11409:x1874711825939840:12345-192.168.206.36@tcp:49:lfs.0 Request processed in 129us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.275470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:1.0:1787864797.283370:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864797.283464:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864797.283848:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940352 00000100:00100000:3.0:1787864797.283857:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940352 00000100:00100000:3.0:1787864797.283942:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:3.0:1787864797.283976:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11409:x1874711825940352:12345-192.168.206.36@tcp:58:lfs.0 00000040:00080000:3.0:1787864797.284127:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787864797.284212:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11409:x1874711825940352:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 238us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864797.284220:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:0.0:1787864797.284595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940096 00000100:00100000:0.0:1787864797.284611:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940096 00000100:00100000:0.0:1787864797.284650:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:0.0:1787864797.284657:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:11410:x1874711825940096:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787864797.284863:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787864797.284921:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1787864797.285063:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285079:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285091:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285099:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285106:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285112:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.285162:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787864797.285225:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+21:11410:x1874711825940096:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 567us (1862us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787864797.285232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 32 00000020:00080000:0.0:1787864797.285243:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787864797.293025:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864797.293038:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.293050:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864797.293054:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.293065:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.293082:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:2.0:1787864797.293085:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787864797.293090:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.293096:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43c2f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864797.297303:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864797.297311:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864797.297314:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864797.330431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.330526:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940480 00000100:00100000:0.0:1787864797.330534:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940480 00000100:00100000:0.0:1787864797.330594:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 141 00000100:00100000:0.0:1787864797.330604:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+21:11412:x1874711825940480:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864797.330627:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864797.330648:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaf2 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330701:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330712:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330723:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330736:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330743:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330750:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330825:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330835:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 22 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330859:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330927:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 22 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.330940:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 22 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864797.330963:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844877568:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864797.331051:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864797.338025:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844877568:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864797.338053:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864797.338384:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.338469:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940736 00000100:00100000:2.0:1787864797.338475:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940736 00000100:00100000:2.0:1787864797.338520:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:2.0:1787864797.338530:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+23:6196:x1874711825940736:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787864797.338726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+24:6196:x1874711825940736:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 197us (342us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787864797.338734:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:3.0:1787864797.341260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864797.341339:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940864 00000100:00100000:2.0:1787864797.341347:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940864 00010000:00010000:2.0:1787864797.341384:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 24 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864797.341428:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 79 00000100:00100000:2.0:1787864797.341437:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+24:2409:x1874711825940864:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864797.341450:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864797.341457:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 24 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341470:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 24 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341490:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43b56 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acab3 expref: 24 pid: 13804 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341506:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864797.341521:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341530:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341537:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864797.341560:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864797.341776:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341794:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864797.341841:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787864797.341846:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864797.341863:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341875:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341913:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341919:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341925:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341930:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864797.341933:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341940:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341961:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:0.0:1787864797.341965:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864797.341968:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341974:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43c3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341985:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341990:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.341996:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342007:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bae00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864797.342011:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342016:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342024:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff927548d9c000) 00010000:00010000:0.0:1787864797.342026:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864797.342028:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342034:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342067:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf2 expref: 24 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342081:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf2 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864797.342088:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864797.342091:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864797.342093:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba800, rc 0) 00000100:00100000:2.0:1787864797.342441:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+23:2409:x1874711825940864:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 1003us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.342450:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 79 00000100:00100000:0.0:1787864797.342514:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11412:x1874711825940480:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 11910us (12090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.342521:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 141 00010000:00010000:1.0:1787864797.530117:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864797.792761:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.792848:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.792872:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.792926:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.792948:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.792988:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864797.793022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825940992 00000100:00100000:0.0:1787864797.793033:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825940992 00000100:00100000:0.0:1787864797.793091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 377 00000100:00100000:0.0:1787864797.793102:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825940992:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864797.793304:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825940992:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 203us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864797.793313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 377 00000100:00100000:2.0:1787864797.793453:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941376 00000100:00100000:2.0:1787864797.793459:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941376 00000100:00100000:2.0:1787864797.793497:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941248 00000100:00100000:2.0:1787864797.793500:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941248 00000100:00100000:2.0:1787864797.793540:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:2.0:1787864797.793548:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825941376:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864797.793582:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825941376:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 35us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.793588:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:2.0:1787864797.793601:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00100000:2.0:1787864797.793607:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825941248:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864797.793630:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825941248:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.793636:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00100000:2.0:1787864797.793654:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941120 00000100:00100000:2.0:1787864797.793666:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941120 00000100:00100000:2.0:1787864797.793695:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941632 00000100:00100000:2.0:1787864797.793698:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941632 00000100:00100000:2.0:1787864797.793716:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941504 00000100:00100000:2.0:1787864797.793718:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941504 00000100:00100000:2.0:1787864797.793742:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 258 00000100:00100000:2.0:1787864797.793749:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825941120:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864797.793793:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2409:x1874711825941120:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.793799:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 258 00000100:00100000:2.0:1787864797.793812:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 259 00000100:00100000:2.0:1787864797.793818:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825941632:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864797.793843:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825941632:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.793849:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 259 00000100:00100000:2.0:1787864797.793860:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 260 00000100:00100000:2.0:1787864797.793867:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825941504:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864797.793919:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825941504:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 52us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864797.793926:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 260 00000100:00080000:2.0:1787864797.793953:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864797.793971:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864797.793975:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864797.980127:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844877696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864797.980196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864797.980389:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844877696 00000100:00100000:1.0:1787864797.980396:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844877696 00000100:00100000:1.0:1787864797.980447:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787864797.980457:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844877696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864797.980489:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1787864797.980536:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844877696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864797.980543:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787864797.980639:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844877696:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787864798.093664:0:14248:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864798.093672:0:14248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864798.093701:0:14248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787864798.093706:0:14248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787864798.297341:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864798.297349:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864798.297372:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787864798.297380:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864798.297507:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b33480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844877824:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864798.297615:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757db8da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864798.304128:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b33480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844877824:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787864798.309263:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864798.312795:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825941760 00000100:00100000:2.0:1787864798.312808:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825941760 00000100:00100000:2.0:1787864798.312936:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 142 00000100:00100000:2.0:1787864798.312947:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11424:x1874711825941760:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864798.312993:0:13804:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787864798.313193:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11424:x1874711825941760:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 247us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864798.313201:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 142 00000100:00080000:3.0:1787864798.314658:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864798.333353:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864798.336158:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825942016 00000100:00100000:2.0:1787864798.336171:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825942016 00000100:00100000:2.0:1787864798.336228:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 143 00000100:00100000:2.0:1787864798.336249:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+22:11424:x1874711825942016:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864798.336267:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864798.336285:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43c52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acaf9 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.336377:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.336390:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.336402:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864798.336412:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787864798.336501:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43c52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf9 expref: 25 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.336518:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf9 expref: 24 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.336525:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864798.336528:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864798.336531:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030200, rc 0) 00000100:00100000:2.0:1787864798.336598:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+24:11424:x1874711825942016:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 351us (3253us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787864798.336627:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 143 00000100:00100000:1.0:1787864798.345868:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864798.345977:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864798.345997:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825942272 00000100:00100000:0.0:1787864798.346005:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825942272 00000100:00100000:0.0:1787864798.346073:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 144 00000100:00100000:0.0:1787864798.346083:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+24:11424:x1874711825942272:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787864798.346154:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346171:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346182:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346318:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346326:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346333:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346339:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864798.346343:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346350:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346362:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864798.346365:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864798.346369:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864798.346384:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43c67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864798.346499:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+25:11424:x1874711825942272:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 417us (639us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787864798.346507:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 144 00000040:00080000:1.0:1787864798.346588:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864798.346593:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787864798.346666:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825942400 00000100:00100000:2.0:1787864798.346671:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825942400 00000100:00100000:2.0:1787864798.346705:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:2.0:1787864798.346712:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+25:2407:x1874711825942400:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864798.346722:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864798.346734:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf9 expref: 25 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864798.346745:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864798.346749:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864798.346766:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+24:2407:x1874711825942400:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 55us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864798.346772:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000040:00080000:1.0:1787864798.347108:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787864798.347116:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864798.350403:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864798.354017:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825942656 00000100:00100000:2.0:1787864798.354029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825942656 00000100:00100000:2.0:1787864798.354091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:2.0:1787864798.354102:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+24:11424:x1874711825942656:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787864798.354303:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+25:11424:x1874711825942656:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 202us (3906us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787864798.354311:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 34 00010000:00010000:3.0:1787864798.553561:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787864799.005619:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787864799.005633:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:0.0:1787864799.578211:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787864800.032825:0:14299:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864800.032834:0:14299:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864800.032865:0:14299:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787864800.032872:0:14299:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864800.312820:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864800.313186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825942912 00000100:00100000:0.0:1787864800.313196:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825942912 00000100:00100000:0.0:1787864800.313276:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 145 00000100:00100000:0.0:1787864800.313286:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+25:11444:x1874711825942912:12345-192.168.206.36@tcp:101:lfs.0 00000100:00080000:3.0:1787864800.313431:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864800.313589:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864800.313611:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb00 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864800.313705:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864800.313729:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864800.313742:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864800.313753:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787864800.313871:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43c6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb00 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864800.313942:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb00 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864800.313951:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:0.0:1787864800.313953:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787864800.313957:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5baa00, rc 0) 00000100:00100000:0.0:1787864800.314010:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+27:11444:x1874711825942912:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 725us (1198us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787864800.314019:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 145 00000100:00100000:1.0:1787864800.322029:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864800.322465:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943040 00000100:00100000:2.0:1787864800.322473:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943040 00000100:00100000:2.0:1787864800.322532:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 146 00000100:00100000:2.0:1787864800.322542:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+27:11444:x1874711825943040:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864800.322620:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322635:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322646:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322678:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322685:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322692:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322698:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864800.322702:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322710:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322721:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:2.0:1787864800.322724:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864800.322728:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.322734:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc43c83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864800.322835:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+27:11444:x1874711825943040:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 294us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.322843:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 146 00000100:00100000:1.0:1787864800.441733:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864800.441847:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943168 00000100:00100000:2.0:1787864800.441856:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943168 00000100:00100000:2.0:1787864800.441968:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:2.0:1787864800.441979:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825943168:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:2.0:1787864800.441998:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864800.442018:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc43c8a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb07 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864800.442050:0:8820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a90a6dc, atime: 0x6a90a6db, ctime: 0x6a90a6dc, blocks: 0x8 00010000:00010000:2.0:1787864800.442069:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1787864800.442073:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864800.442083:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc43c8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb07 expref: 7 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.442100:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc43c8a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb07 expref: 7 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864800.442113:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030200, rc 0) 00000100:00100000:2.0:1787864800.442164:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825943168:12345-192.168.206.36@tcp:101:cat.0 Request processed in 188us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.442171:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00080000:3.0:1787864800.442257:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864800.452746:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864800.453857:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943296 00000100:00100000:2.0:1787864800.453916:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943296 00002000:00100000:2.0:1787864800.453968:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff927448af5680 x1874711825943296/t0(0) o3->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:651/0 lens 488/0 e 0 to 0 dl 1787864811 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864800.453979:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448af5680 with x1874711825943296 ext(0->4095) 00002000:00010000:2.0:1787864800.453985:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448af5680 00000100:00100000:2.0:1787864800.454023:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:2.0:1787864800.454033:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2407:x1874711825943296:12345-192.168.206.36@tcp:3:cat.0 00000100:00100000:2.0:1787864800.454431:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2407:x1874711825943296:12345-192.168.206.36@tcp:3:cat.0 Request processed in 399us (1692us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787864800.454439:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00002000:00100000:2.0:1787864800.454447:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff927448af5680 x1874711825943296/t0(0) o3->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:651/0 lens 488/4536 e 0 to 0 dl 1787864811 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864800.454455:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448af5680 with x1874711825943296 ext(0->4095) 00002000:00010000:2.0:1787864800.454458:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448af5680 00000100:00100000:3.0:1787864800.537278:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864800.537350:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844877952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864800.537416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864800.537537:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844877952 00000100:00100000:0.0:1787864800.537545:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844877952 00000100:00100000:0.0:1787864800.537608:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787864800.537617:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844877952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864800.537645:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787864800.537689:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844877952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864800.537696:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1787864800.537776:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864800.537811:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844877952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864800.538531:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844878208:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.538573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864800.538606:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927547a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844878720:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.538630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864800.538668:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844878336:0@lo:400:kworker.0 00000100:00100000:0.0:1787864800.538727:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864800.538748:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927547a2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844878848:0@lo:400:kworker.0 00000100:00100000:0.0:1787864800.538784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864800.538803:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844879360:0@lo:400:kworker.0 00000100:00100000:0.0:1787864800.538824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864800.538865:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878208 00000100:00100000:0.0:1787864800.538870:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878208 00000100:00100000:0.0:1787864800.538916:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878720 00000100:00100000:0.0:1787864800.538920:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878720 00000100:00100000:1.0:1787864800.539006:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844879232:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.539028:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844878080:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.539038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864800.539081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864800.539108:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927547a2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844878592:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.539139:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864800.539159:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844879104:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.539199:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864800.539217:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844879616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864800.539237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864800.539289:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878080 00000100:00100000:2.0:1787864800.539294:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878080 00000100:00100000:2.0:1787864800.539326:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787864800.539334:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844878080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.539373:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844878080:12345-0@lo:400:kworker.0 Request processed in 40us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.539381:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1787864800.539409:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879104 00000100:00100000:2.0:1787864800.539412:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879104 00000100:00100000:1.0:1787864800.540116:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844878464:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.540163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864800.542882:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844878080:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.543069:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844878976:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.543124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864800.543151:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844879488:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.543194:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864800.543240:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878848 00000100:00100000:1.0:1787864800.543247:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878848 00000100:00100000:2.0:1787864800.543334:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878976 00000100:00100000:2.0:1787864800.543338:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878976 00000100:00100000:2.0:1787864800.543360:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879488 00000100:00100000:2.0:1787864800.543370:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879488 00000100:00100000:2.0:1787864800.543392:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864800.543402:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844879104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543464:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844879104:12345-0@lo:400:kworker.0 Request processed in 65us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.543472:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787864800.543486:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864800.543491:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844878976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543519:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844878976:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.543525:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787864800.543535:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864800.543541:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844879488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543570:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844879488:12345-0@lo:400:kworker.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.543577:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864800.543622:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844878976:0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543635:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844879488:0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543682:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878336 00000100:00100000:2.0:1787864800.543686:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878336 00000100:00100000:2.0:1787864800.543707:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878592 00000100:00100000:2.0:1787864800.543710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878592 00000100:00100000:2.0:1787864800.543725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787864800.543732:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844878336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543789:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844878336:12345-0@lo:400:kworker.0 Request processed in 57us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.543806:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787864800.543820:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787864800.543827:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844878592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.543867:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844878592:12345-0@lo:400:kworker.0 Request processed in 40us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.543873:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787864800.543915:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879360 00000100:00100000:2.0:1787864800.543920:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879360 00000100:00100000:3.0:1787864800.544139:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927547a2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844878592:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544150:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1787864800.544155:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1787864800.544171:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9275589983c0, transno 4294967302 00000004:00080000:3.0:1787864800.544181:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1787864800.544191:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff927448b552c0, transno 4294967305 00000100:00100000:3.0:1787864800.544196:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844879104:0@lo:400:kworker.0 00000100:00080000:3.0:1787864800.544337:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787864800.544342:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864800.544345:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864800.544346:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864800.544357:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879232 00000100:00100000:3.0:1787864800.544360:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879232 00000100:00100000:3.0:1787864800.544385:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844878464 00000100:00100000:3.0:1787864800.544388:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844878464 00000100:00100000:3.0:1787864800.544401:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787864800.544407:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844878208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544449:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844878208:12345-0@lo:400:kworker.0 Request processed in 42us (5876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864800.544456:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787864800.544470:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787864800.544476:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844878720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544519:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844878720:12345-0@lo:400:kworker.0 Request processed in 43us (5889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864800.544525:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787864800.544537:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787864800.544544:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844879232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544571:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844879232:12345-0@lo:400:kworker.0 Request processed in 28us (5534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864800.544577:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787864800.544595:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787864800.544602:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844878464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544635:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844878464:12345-0@lo:400:kworker.0 Request processed in 34us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864800.544642:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:3.0:1787864800.544656:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864800.544677:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844878464:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544749:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879616 00000100:00100000:3.0:1787864800.544753:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879616 00000100:00100000:3.0:1787864800.544793:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864800.544805:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844879616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864800.544818:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787864800.544856:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844879616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864800.544861:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864800.544911:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844878336:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.544954:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844879616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864800.545007:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844878208:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.545018:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927547a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844878720:0@lo:400:kworker.0 00000100:00100000:3.0:1787864800.545026:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844879232:0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.545300:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787864800.545309:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844879360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864800.545363:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844879360:12345-0@lo:400:kworker.0 Request processed in 56us (6538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864800.545370:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:2.0:1787864800.545400:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fb6a940 x1874711844879360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864800.545412:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844879360:0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.545692:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787864800.545700:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844878848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864800.545742:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844878848:12345-0@lo:400:kworker.0 Request processed in 43us (6958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864800.545747:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00080000:2.0:1787864800.545826:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927547a2bc00 x1874711844878848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864800.545836:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927547a2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844878848:0@lo:400:kworker.0 00010000:00010000:3.0:1787864800.601150:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864801.561537:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864801.561559:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844879744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864801.561622:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864801.561680:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879744 00000100:00100000:0.0:1787864801.561686:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879744 00000100:00100000:0.0:1787864801.561741:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864801.561750:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844879744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864801.561792:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864801.561833:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844879744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864801.561840:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864801.561876:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844879744:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864801.629639:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864802.073110:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864802.073395:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844879872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864802.073499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864802.073663:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844879872 00000100:00100000:0.0:1787864802.073670:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844879872 00000100:00100000:0.0:1787864802.073749:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787864802.073776:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844879872:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864802.073778:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844880000:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864802.073808:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864802.073817:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864802.073864:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844879872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864802.073872:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787864802.073910:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880000 00000100:00100000:3.0:1787864802.073915:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880000 00000100:00100000:3.0:1787864802.073952:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787864802.073960:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844880000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787864802.073971:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787864802.074036:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864802.074361:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844880000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 401us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864802.074368:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787864802.074411:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844879872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864802.074507:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844880000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787864802.655184:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864802.911122:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911213:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911271:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911296:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911313:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911329:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.911352:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864802.912563:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943680 00000100:00100000:1.0:1787864802.912575:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943680 00000100:00100000:1.0:1787864802.912630:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944192 00000100:00100000:1.0:1787864802.912634:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944192 00000100:00100000:1.0:1787864802.912653:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943552 00000100:00100000:1.0:1787864802.912656:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943552 00000100:00100000:1.0:1787864802.912669:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944064 00000100:00100000:1.0:1787864802.912672:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944064 00000100:00100000:1.0:1787864802.912690:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 267 00000100:00100000:1.0:1787864802.912698:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825943680:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864802.912774:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825943680:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 76us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864802.912789:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 267 00000100:00100000:1.0:1787864802.912807:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 268 00000100:00100000:1.0:1787864802.912814:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825944192:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864802.912840:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825944192:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 27us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864802.912846:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 268 00000100:00100000:1.0:1787864802.912859:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 269 00000100:00100000:1.0:1787864802.912865:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+27:2410:x1874711825943552:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864802.912905:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+27:2410:x1874711825943552:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864802.912913:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 269 00000100:00100000:1.0:1787864802.912926:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 270 00000100:00100000:1.0:1787864802.912932:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825944064:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864802.912956:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825944064:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 24us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864802.912962:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 270 00000100:00080000:1.0:1787864802.912977:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864802.912980:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864802.914693:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943936 00000100:00100000:3.0:1787864802.914704:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943936 00000100:00100000:3.0:1787864802.914765:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943808 00000100:00100000:3.0:1787864802.914769:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943808 00000100:00100000:3.0:1787864802.914798:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 102 00000100:00100000:3.0:1787864802.914806:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825943936:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864802.914863:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825943936:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 58us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864802.914871:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 102 00000100:00100000:3.0:1787864802.914914:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00100000:3.0:1787864802.914928:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825943808:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864802.914954:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825943808:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 28us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864802.914960:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00080000:3.0:1787864802.914975:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864802.914979:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864802.917594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825943424 00000100:00100000:2.0:1787864802.917614:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825943424 00000100:00100000:3.0:1787864802.919036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 379 00000100:00100000:3.0:1787864802.919048:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825943424:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864802.919120:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2410:x1874711825943424:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 74us (8006us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864802.919128:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 379 00000001:00080000:3.0:1787864803.105424:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1787864803.105439:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787864803.105484:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1787864803.105504:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff927549cfa900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787864803.105510:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc2a200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff927549cfa480 00000020:00080000:3.0:1787864803.105513:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92757dc2a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff927542df4a00 00000020:00080000:3.0:1787864803.105530:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1787864803.105568:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105580:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105587:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105604:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864803.105609:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105617:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105635:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff927448159a00) 00010000:00010000:3.0:1787864803.105639:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864803.105644:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864803.105650:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43c05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787864803.105681:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787864803.105744:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787864803.109473:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844880128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864803.109537:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864803.109821:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880128 00000100:00100000:3.0:1787864803.109829:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880128 00000100:00100000:3.0:1787864803.109881:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787864803.110013:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844880128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864803.110049:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787864803.110147:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844880128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 257us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864803.110155:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787864803.110223:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844880128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787864803.674076:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864804.640531:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864804.640627:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944320 00000100:00100000:1.0:1787864804.640636:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944320 00000100:00100000:1.0:1787864804.640718:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 147 00000100:00080000:3.0:1787864804.640766:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864804.640802:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+13:11097:x1874711825944320:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787864804.640940:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+13:11097:x1874711825944320:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 Request processed in 212us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864804.644302:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 147 00000100:00100000:1.0:1787864804.646920:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864804.646995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944448 00000100:00100000:0.0:1787864804.647004:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944448 00000100:00100000:0.0:1787864804.647074:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 148 00000100:00100000:0.0:1787864804.647084:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:11097:x1874711825944448:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787864804.647180:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:11097:x1874711825944448:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864804.647188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 148 00000100:00080000:3.0:1787864804.648582:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864804.650800:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864804.651105:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944704 00000100:00100000:0.0:1787864804.651117:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944704 00000100:00100000:0.0:1787864804.651186:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:0.0:1787864804.651197:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+13:11097:x1874711825944704:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787864804.656362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+14:11097:x1874711825944704:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 5157us (5565us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787864804.656374:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 35 00010000:00010000:3.0:1787864804.697675:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864804.905158:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864804.905278:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944832 00000100:00100000:3.0:1787864804.905290:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944832 00000100:00100000:3.0:1787864804.905386:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 149 00000100:00100000:3.0:1787864804.905397:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:11902:x1874711825944832:12345-192.168.206.36@tcp:101:lsof.0 00010000:00010000:3.0:1787864804.905423:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864804.905448:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43c91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb0e expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905542:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905559:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905582:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864804.905642:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864804.905646:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864804.905692:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905719:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 7 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905754:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 6 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864804.905764:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:3.0:1787864804.905784:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864804.905789:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e200, rc 0) 00000100:00100000:3.0:1787864804.905870:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:11902:x1874711825944832:12345-192.168.206.36@tcp:101:lsof.0 Request processed in 475us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864804.905878:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 149 00000100:00080000:1.0:1787864804.906548:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1787864805.529160:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864805.529173:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864805.529302:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787864805.529310:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864805.657153:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927547a2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844880256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864805.657265:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844880512:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.657271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.657372:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844880768:0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.657486:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844880640:0@lo:400:kworker.0 00000100:00100000:2.0:1787864805.657567:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880256 00000100:00100000:2.0:1787864805.657575:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880256 00000100:00100000:2.0:1787864805.657643:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787864805.657656:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844880256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787864805.657694:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787864805.659973:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.660088:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844880384:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.660141:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.660195:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844880896:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.660226:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.660482:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844881408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.660505:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844881024:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.660520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864805.660543:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.660549:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844881920:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.660580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864805.660582:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844881536:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.660614:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.660638:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880384 00000100:00100000:0.0:1787864805.660645:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844882048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864805.660696:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864805.660727:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882048 00000100:00100000:0.0:1787864805.660734:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882048 00000100:00100000:0.0:1787864805.660807:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787864805.660817:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844882048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864805.660845:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787864805.660917:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844882048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.660925:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787864805.660953:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880512 00000100:00100000:0.0:1787864805.660957:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880512 00000100:00100000:0.0:1787864805.660988:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881024 00000100:00100000:0.0:1787864805.661009:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881024 00000100:00100000:0.0:1787864805.661032:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881536 00000100:00100000:0.0:1787864805.661035:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881536 00000100:00100000:0.0:1787864805.661054:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787864805.661061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844880512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844880512:12345-0@lo:400:kworker.0 Request processed in 35us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787864805.661115:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787864805.661120:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844881024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661143:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844881024:12345-0@lo:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661149:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787864805.661158:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787864805.661163:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661199:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844881536:12345-0@lo:400:kworker.0 Request processed in 36us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661205:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787864805.661232:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880384 00000100:00100000:0.0:1787864805.661248:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1787864805.661255:0:3637:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1787864805.661284:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844882048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864805.661297:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844880512:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661307:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb69e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844881024:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661316:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844881536:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661344:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864805.661369:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844881280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.661420:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787864805.661427:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844881792:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.661431:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844880384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864805.661491:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881408 00000100:00100000:0.0:1787864805.661496:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881408 00000100:00100000:3.0:1787864805.661501:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844880384:12345-0@lo:400:kworker.0 Request processed in 72us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864805.661509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1787864805.661530:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881920 00000100:00100000:0.0:1787864805.661534:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881920 00000100:00100000:0.0:1787864805.661549:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881280 00000100:00100000:0.0:1787864805.661551:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881280 00000100:00100000:3.0:1787864805.661560:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880896 00000100:00100000:0.0:1787864805.661565:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881792 00000100:00100000:3.0:1787864805.661568:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880896 00000100:00100000:0.0:1787864805.661570:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881792 00000100:00100000:0.0:1787864805.661584:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787864805.661593:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844881408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.661629:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787864805.661634:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844881408:12345-0@lo:400:kworker.0 Request processed in 41us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864805.661644:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661652:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787864805.661667:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787864805.661673:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844881920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661702:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844881920:12345-0@lo:400:kworker.0 Request processed in 30us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661709:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787864805.661718:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787864805.661723:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757e005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661767:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757e005850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844881280:12345-0@lo:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661773:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787864805.661948:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787864805.661955:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1874711844881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.661983:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3639:x1874711844881792:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.661989:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787864805.662014:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880768 00000100:00100000:0.0:1787864805.662018:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880768 00000100:00100000:0.0:1787864805.662040:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787864805.662045:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844880768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.662074:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844880768:12345-0@lo:400:kworker.0 Request processed in 29us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.662080:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787864805.662117:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844880768:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.662128:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844881280:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.662148:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844881792:0@lo:400:kworker.0 00000100:00080000:0.0:1787864805.662203:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864805.662210:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864805.662212:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864805.662284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844880384:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.662299:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844881408:0@lo:400:kworker.0 00000100:00100000:0.0:1787864805.662312:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844881920:0@lo:400:kworker.0 00000100:00100000:3.0:1787864805.665104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844880896:12345-0@lo:400:kworker.0 Request processed in 3457us (4869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864805.665121:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787864805.665364:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844880896:0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.666454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864805.666509:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844881152:0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.666552:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864805.666573:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844881664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.666600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864805.668451:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844880640 00000100:00100000:3.0:1787864805.668468:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844880640 00000100:00100000:3.0:1787864805.668551:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787864805.668564:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844880640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.669083:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881152 00000100:00100000:1.0:1787864805.669091:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881152 00000100:00100000:1.0:1787864805.669144:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844881664 00000100:00100000:0.0:1787864805.669211:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787864805.669223:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844881152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864805.669416:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844880256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11761us (12146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864805.669428:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787864805.669525:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927547a2bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844880256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864805.669651:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844881152:12345-0@lo:400:kworker.0 Request processed in 431us (3098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864805.669658:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:0.0:1787864805.669701:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864805.671582:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844880640:12345-0@lo:400:kworker.0 Request processed in 3009us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864805.671599:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787864805.671839:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844881664 00000100:00100000:1.0:1787864805.671964:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787864805.671974:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844881664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864805.672064:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844881664:12345-0@lo:400:kworker.0 Request processed in 91us (5462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864805.672071:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1787864805.672232:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864805.675616:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844880640:0@lo:400:kworker.0 00010000:00080000:0.0:1787864805.675652:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fb6a940 x1874711844881152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864805.675665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844881152:0@lo:400:kworker.0 00010000:00080000:0.0:1787864805.675680:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fb6b480 x1874711844881664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864805.675690:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844881664:0@lo:400:kworker.0 00010000:00010000:1.0:1787864805.722106:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864805.915074:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787864806.681318:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844882176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864806.681419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864806.681578:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882176 00000100:00100000:0.0:1787864806.681605:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882176 00000100:00100000:0.0:1787864806.681673:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787864806.681684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844882176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864806.681950:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864806.682222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844882176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 520us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864806.682235:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787864806.682388:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844882176:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864806.745423:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864807.194777:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844882304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864807.194844:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864807.194941:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864807.194949:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844882432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864807.194973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864807.195047:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882304 00000100:00100000:2.0:1787864807.195055:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882304 00000100:00100000:2.0:1787864807.195110:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882432 00000100:00100000:2.0:1787864807.195113:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882432 00000100:00100000:2.0:1787864807.195132:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864807.195140:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844882304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864807.195168:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864807.195211:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844882304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864807.195218:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787864807.195234:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787864807.195241:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844882432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864807.195263:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787864807.195287:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844882432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864807.195294:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787864807.195556:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864807.195591:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844882432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864807.195602:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844882304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864807.773089:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864808.032694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032742:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032768:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032790:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032809:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032829:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032851:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864808.032877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825944960 00000100:00100000:1.0:1787864808.032885:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825944960 00000100:00100000:1.0:1787864808.032947:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 381 00000100:00100000:1.0:1787864808.032957:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825944960:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.033020:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825944960:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 64us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.033028:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 381 00000100:00100000:1.0:1787864808.033059:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945216 00000100:00100000:1.0:1787864808.033063:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945216 00000100:00100000:1.0:1787864808.033096:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945728 00000100:00100000:1.0:1787864808.033099:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945728 00000100:00100000:1.0:1787864808.033118:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945088 00000100:00100000:1.0:1787864808.033121:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945088 00000100:00100000:1.0:1787864808.033133:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945600 00000100:00100000:1.0:1787864808.033135:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945600 00000100:00100000:1.0:1787864808.033148:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 277 00000100:00100000:1.0:1787864808.033154:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825945216:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.033185:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825945216:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.033192:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 277 00000100:00100000:1.0:1787864808.033214:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 278 00000100:00100000:1.0:1787864808.033221:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825945728:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.033247:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825945728:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.033253:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 278 00000100:00100000:1.0:1787864808.033264:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 279 00000100:00100000:1.0:1787864808.033270:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+14:2408:x1874711825945088:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.033295:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+14:2408:x1874711825945088:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.033301:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 279 00000100:00100000:1.0:1787864808.033312:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 280 00000100:00100000:1.0:1787864808.033319:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825945600:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.033341:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825945600:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.033347:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 280 00000100:00100000:1.0:1787864808.033366:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945472 00000100:00100000:1.0:1787864808.033369:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945472 00000100:00100000:1.0:1787864808.033395:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945344 00000100:00100000:1.0:1787864808.033398:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945344 00000100:00100000:1.0:1787864808.035670:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 108 00000100:00100000:1.0:1787864808.035685:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825945472:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.035759:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2408:x1874711825945472:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 78us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.035767:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 108 00000100:00100000:1.0:1787864808.035794:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 109 00000100:00100000:1.0:1787864808.035801:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825945344:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864808.035830:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825945344:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864808.035835:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 109 00000100:00080000:1.0:1787864808.036615:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864808.036620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787864808.036624:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864808.036626:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787864808.221571:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864808.224343:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844882560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864808.224413:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864808.224531:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882560 00000100:00100000:2.0:1787864808.224538:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882560 00000100:00100000:2.0:1787864808.224586:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787864808.224595:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844882560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864808.224626:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1787864808.224681:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844882560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864808.224688:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787864808.226122:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844882560:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787864808.303711:0:14496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:06:46 (1787864806) 00000001:00080000:2.0:1787864808.731591:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787864808.731602:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787864808.731671:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787864808.731692:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1787864808.793809:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864809.563774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864809.563937:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825945984 00000100:00100000:1.0:1787864809.563946:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825945984 00000100:00100000:1.0:1787864809.564005:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 150 00000100:00100000:1.0:1787864809.564014:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+13:12169:x1874711825945984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864809.564031:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864809.564049:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43c9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb15 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564112:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564126:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564138:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564189:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564197:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564205:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564291:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43cb4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564300:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564308:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864809.564317:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787864809.564389:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564397:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564403:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564410:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864809.564414:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564431:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564443:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9275687e8700) 00010000:00010000:1.0:1787864809.564446:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864809.564450:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564456:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc43ca6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564469:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564475:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564481:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564487:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864809.564490:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564496:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564503:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff927447234900) 00010000:00010000:1.0:1787864809.564506:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864809.564509:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.564524:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43cad lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.565630:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43c9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb15 expref: 16 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.565651:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb15 expref: 15 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864809.565659:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864809.565662:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864809.565665:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949c00, rc 0) 00000100:00100000:1.0:1787864809.565740:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+15:12169:x1874711825945984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1726us (1986us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787864809.565748:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 150 00000100:00100000:1.0:1787864809.576982:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864809.577030:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864809.577116:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946240 00000100:00100000:0.0:1787864809.577124:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946240 00000100:00100000:0.0:1787864809.577181:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 151 00000100:00100000:0.0:1787864809.577191:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+15:12169:x1874711825946240:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787864809.577292:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+15:12169:x1874711825946240:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 103us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864809.577300:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 151 00000100:00100000:2.0:1787864809.577383:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946112 00000100:00100000:2.0:1787864809.577387:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946112 00000100:00100000:2.0:1787864809.577427:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:2.0:1787864809.577435:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+15:2409:x1874711825946112:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864809.577446:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864809.577468:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43cb4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb15 expref: 15 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864809.577487:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:2.0:1787864809.577493:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864809.577517:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+14:2409:x1874711825946112:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 82us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864809.577525:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:0.0:1787864809.582397:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864809.582527:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946368 00000100:00100000:1.0:1787864809.582535:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946368 00000100:00100000:1.0:1787864809.582597:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 152 00000100:00100000:1.0:1787864809.582608:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:12169:x1874711825946368:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787864809.582713:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:12169:x1874711825946368:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864809.582731:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 152 00000040:00080000:1.0:1787864809.625091:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864809.625099:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864809.625126:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787864809.625134:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787864809.817040:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864810.010540:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787864810.777387:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864810.777460:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864810.777527:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882688 00000100:00100000:2.0:1787864810.777533:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882688 00000100:00100000:2.0:1787864810.777578:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787864810.777587:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844882688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864810.777613:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787864810.777654:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844882688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864810.777661:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1787864810.777692:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864810.777734:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864810.778216:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864810.778227:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844882816:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864810.778259:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.778307:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882816 00000100:00100000:3.0:1787864810.778311:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882816 00000100:00100000:3.0:1787864810.778345:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864810.778353:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844882816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787864810.778365:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787864810.778396:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844882816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.778414:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864810.778447:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844882816:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787864810.778463:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864810.778574:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844882944:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.778602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.778626:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844883456:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.778649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.778668:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92744888b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844883968:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.778867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.779011:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787864810.779018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844883328:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.779072:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274488892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844883840:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.779119:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844882944 00000100:00100000:3.0:1787864810.779123:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844882944 00000100:00100000:3.0:1787864810.779152:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787864810.779158:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844882944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779371:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844882944:12345-0@lo:400:kworker.0 Request processed in 212us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.779378:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1787864810.779407:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883456 00000100:00100000:3.0:1787864810.779411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883456 00000100:00100000:3.0:1787864810.779435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787864810.779441:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844883456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779481:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844883456:12345-0@lo:400:kworker.0 Request processed in 40us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.779488:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787864810.779506:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883968 00000100:00100000:3.0:1787864810.779510:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883968 00000100:00100000:3.0:1787864810.779539:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883840 00000100:00100000:3.0:1787864810.779542:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883840 00000100:00100000:3.0:1787864810.779562:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864810.779568:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844883968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779598:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fade1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844883968:12345-0@lo:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.779604:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787864810.779615:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864810.779621:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844883840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779646:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844883840:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.779652:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787864810.779668:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883328 00000100:00100000:3.0:1787864810.779672:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883328 00000100:00100000:3.0:1787864810.779799:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787864810.779806:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844883328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.779839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755899a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874711844883328:12345-0@lo:400:kworker.0 Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.779845:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1787864810.780368:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844883328:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780388:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274488892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844883840:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780409:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b54780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844882944:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780419:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b56940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844883456:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780428:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92744888b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844883968:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780475:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844883072:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780533:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844883584:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780574:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844884096:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780614:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787864810.780620:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844883200:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780659:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844883712:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780691:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780719:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844884224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.780745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864810.780772:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883072 00000100:00100000:3.0:1787864810.780776:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883072 00000100:00100000:3.0:1787864810.780802:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883584 00000100:00100000:3.0:1787864810.780805:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883584 00000100:00100000:3.0:1787864810.780818:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844884096 00000100:00100000:3.0:1787864810.780820:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844884096 00000100:00100000:3.0:1787864810.780830:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883712 00000100:00100000:3.0:1787864810.780832:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883712 00000100:00100000:3.0:1787864810.780841:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844884224 00000100:00100000:3.0:1787864810.780848:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844884224 00000100:00100000:3.0:1787864810.780867:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787864810.780873:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744888b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844883072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782399:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744888b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844883072:12345-0@lo:400:kworker.0 Request processed in 1521us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782410:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787864810.782438:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787864810.782447:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844883584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782478:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844883584:12345-0@lo:400:kworker.0 Request processed in 35us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782484:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787864810.782496:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787864810.782503:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844884096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782530:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844884096:12345-0@lo:400:kworker.0 Request processed in 28us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782536:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787864810.782548:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787864810.782555:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844883712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782582:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844883712:12345-0@lo:400:kworker.0 Request processed in 28us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782587:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787864810.782599:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787864810.782605:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844884224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782632:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844884224:12345-0@lo:400:kworker.0 Request processed in 28us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782651:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787864810.782693:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844883200 00000100:00100000:3.0:1787864810.782700:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844883200 00000100:00100000:3.0:1787864810.782738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787864810.782744:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844883200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.782778:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844883200:12345-0@lo:400:kworker.0 Request processed in 34us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864810.782784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787864810.782834:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844883200:0@lo:400:kworker.0 00010000:00080000:3.0:1787864810.782847:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dc16940 x1874711844883712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864810.782857:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844883712:0@lo:400:kworker.0 00010000:00080000:3.0:1787864810.782868:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448889680 x1874711844884224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787864810.783021:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864810.783026:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864810.783029:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864810.785150:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448889680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844884224:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.785396:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844883072:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.785412:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448b57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844883584:0@lo:400:kworker.0 00000100:00100000:3.0:1787864810.785424:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448888b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844884096:0@lo:400:kworker.0 00010000:00010000:0.0:1787864810.846668:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864811.262358:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864811.262391:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946496 00000100:00100000:3.0:1787864811.262399:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946496 00000100:00100000:3.0:1787864811.262461:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 153 00000100:00100000:3.0:1787864811.262472:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+14:12211:x1874711825946496:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864811.262687:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864811.262717:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb1c expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262776:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262789:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262801:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262814:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262822:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262828:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262866:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.262874:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263147:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263153:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864811.263165:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263172:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263184:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:3.0:1787864811.263187:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864811.263192:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263199:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263211:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263218:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263225:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263230:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864811.263233:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263239:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263245:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff927549cf1300) 00010000:00010000:3.0:1787864811.263248:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864811.263256:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263263:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263293:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb1c expref: 15 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263303:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:3.0:1787864811.263306:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864811.263310:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb1c expref: 15 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.263319:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e600, rc 0) 00000100:00100000:3.0:1787864811.263383:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448888b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+14:12211:x1874711825946496:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 913us (1034us total) trans 0 rc 301/301 00000100:00100000:3.0:1787864811.263391:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 153 00000100:00080000:3.0:1787864811.263416:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864811.275620:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.275655:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946752 00000100:00100000:2.0:1787864811.275663:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946752 00000100:00100000:2.0:1787864811.275727:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 154 00000100:00100000:2.0:1787864811.275736:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+14:12211:x1874711825946752:12345-192.168.206.36@tcp:36:lfs.0 00010000:00010000:2.0:1787864811.275787:0:10168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864811.275813:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac940 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.275830:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:2.0:1787864811.275835:0:10168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864811.275920:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.275947:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 5 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.275955:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.275985:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 5 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.275998:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 5 pid: 10168 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864811.276010:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844884352:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864811.276099:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787864811.282068:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.282148:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825946880 00000100:00100000:1.0:1787864811.282156:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825946880 00010000:00010000:1.0:1787864811.282211:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 6 pid: 10168 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864811.282245:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 80 00000100:00100000:1.0:1787864811.282254:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2409:x1874711825946880:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864811.282269:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864811.282276:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 6 pid: 10168 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.282288:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 6 pid: 10168 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.282310:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:1.0:1787864811.282316:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.282324:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.282331:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.282348:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864811.282390:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2409:x1874711825946880:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.282414:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 80 00000100:00080000:2.0:1787864811.282601:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864811.282962:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43c98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb0e expref: 5 pid: 10168 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864811.282980:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844884352:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864811.282998:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283006:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283012:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283033:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283042:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283050:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283563:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283573:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283582:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864811.283608:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000579148e7 reply state 00000000abf902ea transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283619:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283626:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864811.283629:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864811.283632:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787864811.283637:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787864811.283643:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283650:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283657:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283663:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.283667:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283674:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283683:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927548558900) 00010000:00010000:0.0:1787864811.283685:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.283689:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283703:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43cd7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864811.283731:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000579148e7 reply state 00000000abf902ea transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283740:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.283746:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff927548d9cf00) 00010000:00010000:0.0:1787864811.283748:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864811.283750:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787864811.283823:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+15:12211:x1874711825946752:12345-192.168.206.36@tcp:36:lfs.0 Request processed in 8088us (8209us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787864811.283831:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 154 00000100:00100000:2.0:1787864811.381486:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864811.383272:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947008 00000100:00100000:3.0:1787864811.383283:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947008 00000100:00100000:3.0:1787864811.383347:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 155 00000100:00100000:3.0:1787864811.383356:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+15:12219:x1874711825947008:12345-192.168.206.36@tcp:101:lctl.0 00010000:00010000:3.0:1787864811.383377:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864811.383396:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb23 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383451:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383479:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383490:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864811.383533:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864811.383536:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864811.383554:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383575:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb23 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383591:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb23 expref: 16 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.383599:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864811.383601:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864811.383605:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f800, rc 0) 00000100:00100000:3.0:1787864811.383667:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+16:12219:x1874711825947008:12345-192.168.206.36@tcp:101:lctl.0 Request processed in 311us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864811.383674:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 155 00000100:00100000:2.0:1787864811.439968:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864811.440158:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947136 00000100:00100000:3.0:1787864811.440168:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947136 00000100:00100000:3.0:1787864811.440437:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 156 00000100:00100000:3.0:1787864811.440447:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+16:12225:x1874711825947136:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864811.440465:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864811.440495:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb2a expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440558:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440570:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440582:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440594:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440601:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440607:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440685:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440694:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.440701:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864811.440749:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787864811.440752:0:13804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864811.441218:0:13804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441241:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441247:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441253:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441259:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864811.441262:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441779:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441794:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864811.441797:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864811.441802:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441809:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441825:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441832:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441838:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441851:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864811.441855:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.441861:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.442088:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff927548d9cf00) 00010000:00010000:3.0:1787864811.442092:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864811.442096:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.442103:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43d08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.442137:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb2a expref: 18 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.442151:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb2a expref: 17 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.442158:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864811.442160:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787864811.442163:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f200, rc 0) 00000100:00100000:3.0:1787864811.442238:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+17:12225:x1874711825947136:12345-192.168.206.36@tcp:101:bash.0 Request processed in 1791us (2278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864811.442246:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 156 00000100:00100000:0.0:1787864811.446825:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.447422:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947392 00000100:00100000:2.0:1787864811.447432:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947392 00000100:00100000:2.0:1787864811.447563:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 157 00000100:00100000:2.0:1787864811.447573:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+17:12225:x1874711825947392:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864811.447593:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864811.447613:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43d16 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb31 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.447734:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.447762:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.448150:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.448657:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.448668:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.448676:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864811.449480:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787864811.449631:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449642:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449650:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449684:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449692:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449699:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449730:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864811.449734:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.449742:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450640:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864811.450643:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864811.450649:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450656:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43d1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864811.450672:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000673646f1 reply state 000000003d61f93b transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450683:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450690:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:2.0:1787864811.450692:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864811.450695:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787864811.450750:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43d16 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450766:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.450852:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:2.0:1787864811.450855:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864811.450857:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031600, rc 0) 00000100:00100000:2.0:1787864811.451104:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+20:12225:x1874711825947392:12345-192.168.206.36@tcp:101:bash.0 Request processed in 3531us (4288us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1787864811.451113:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 157 00000100:00100000:2.0:1787864811.456730:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.456885:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947520 00000100:00100000:1.0:1787864811.456921:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947520 00000100:00080000:2.0:1787864811.456951:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864811.456983:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:1.0:1787864811.456993:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2407:x1874711825947520:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:1.0:1787864811.457009:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864811.457028:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb38 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864811.457052:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864811.457070:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1787864811.457075:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864811.457084:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.457104:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 6 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.457118:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948c00, rc 0) 00000100:00100000:1.0:1787864811.457165:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2407:x1874711825947520:12345-192.168.206.36@tcp:101:bash.0 Request processed in 173us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.457177:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:3.0:1787864811.460735:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.460963:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947648 00000100:00100000:1.0:1787864811.460972:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947648 00000100:00100000:1.0:1787864811.461031:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:1.0:1787864811.461040:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+6:12225:x1874711825947648:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:1.0:1787864811.461064:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864811.461081:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb3f expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.461113:0:14166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.461122:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864811.461126:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864811.461131:0:14166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 7 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.461164:0:14166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.461178:0:14166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864811.461203:0:14166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489a1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14166:1874711844884480:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864811.461409:0:14166:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864811.464566:0:14166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489a1a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14166:1874711844884480:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864811.464599:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 7 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.464619:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948400, rc 0) 00000100:00100000:1.0:1787864811.464689:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448889680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+7:12225:x1874711825947648:12345-192.168.206.36@tcp:101:bash.0 Request processed in 3649us (3960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.464699:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:3.0:1787864811.466106:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.466220:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825947776 00000100:00100000:0.0:1787864811.466228:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825947776 00010000:00010000:0.0:1787864811.466426:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864811.466470:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:0.0:1787864811.466485:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825947776:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864811.466499:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864811.466521:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.466552:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.466575:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc43d39 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb38 expref: 7 pid: 8426 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.466591:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864811.466595:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864811.466604:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.466614:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.466724:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864811.466739:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1874711844884608:192.168.206.36@tcp:105: 00000100:00100000:0.0:1787864811.467022:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864811.470640:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6497:1874711844884608:192.168.206.36@tcp:105: 00010000:00010000:1.0:1787864811.470667:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864811.470771:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825947776:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 4291us (4670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.470782:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:2.0:1787864811.474747:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.474856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825948032 00000100:00100000:0.0:1787864811.474864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825948032 00000100:00100000:0.0:1787864811.474994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:0.0:1787864811.475005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+20:12225:x1874711825948032:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:0.0:1787864811.475371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12225:x1874711825948032:12345-192.168.206.36@tcp:35:bash.0 Request processed in 366us (630us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787864811.475392:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:3.0:1787864811.575648:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.575832:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825948288 00000100:00100000:0.0:1787864811.575841:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825948288 00000100:00100000:0.0:1787864811.575949:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 158 00000100:00100000:0.0:1787864811.575958:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12235:x1874711825948288:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864811.575981:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864811.576002:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb46 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864811.576093:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787864811.576478:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb46 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.576494:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:0.0:1787864811.576497:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864811.576502:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb46 expref: 23 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.576515:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bae00, rc 0) 00000100:00100000:0.0:1787864811.576610:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:12235:x1874711825948288:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 652us (970us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1787864811.576618:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 158 00000100:00100000:1.0:1787864811.582669:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.582780:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825948544 00000100:00100000:2.0:1787864811.582788:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825948544 00000100:00100000:2.0:1787864811.583076:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:2.0:1787864811.583087:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:12235:x1874711825948544:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864811.583326:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+23:12235:x1874711825948544:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 241us (665us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787864811.583334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:2.0:1787864811.672258:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.672463:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825948672 00000100:00100000:0.0:1787864811.672473:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825948672 00000100:00100000:0.0:1787864811.672534:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:0.0:1787864811.672544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+23:12242:x1874711825948672:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864811.672582:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864811.672605:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672663:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672675:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672685:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864811.672734:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787864811.672737:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864811.672755:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672778:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb4d expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672794:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb4d expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.672802:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864811.672805:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864811.672809:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb600, rc 0) 00000100:00100000:0.0:1787864811.672867:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+24:12242:x1874711825948672:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 325us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864811.672883:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:3.0:1787864811.682459:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.684535:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825948928 00000100:00100000:0.0:1787864811.684548:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825948928 00000100:00100000:0.0:1787864811.684731:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:0.0:1787864811.684743:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+24:12242:x1874711825948928:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864811.684763:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864811.684782:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb54 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.684913:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43d6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.684927:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.684939:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864811.684950:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787864811.686559:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43d63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb54 expref: 27 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.686584:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb54 expref: 26 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.686592:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:0.0:1787864811.686595:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864811.686599:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba400, rc 0) 00000100:00100000:0.0:1787864811.686674:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+26:12242:x1874711825948928:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1933us (4223us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1787864811.686698:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:1.0:1787864811.690819:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.690953:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949184 00000100:00100000:2.0:1787864811.690962:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949184 00000100:00100000:2.0:1787864811.692648:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 161 00000100:00100000:2.0:1787864811.692667:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+26:12242:x1874711825949184:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864811.692689:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864811.692719:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43d78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb5b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.692829:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.692842:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.692853:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864811.692864:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787864811.692974:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb5b expref: 29 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.692991:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb5b expref: 28 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.693000:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:2.0:1787864811.693003:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787864811.693006:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864811.693073:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+28:12242:x1874711825949184:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 415us (2263us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787864811.693081:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 161 00000100:00100000:3.0:1787864811.694174:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.694310:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949312 00000100:00100000:1.0:1787864811.694318:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949312 00000100:00100000:1.0:1787864811.694374:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:1.0:1787864811.694382:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b56580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+28:2407:x1874711825949312:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864811.694392:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864811.694410:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb54 expref: 28 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.694425:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:1.0:1787864811.694429:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864811.694473:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b56580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+27:2407:x1874711825949312:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 92us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.694480:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:3.0:1787864811.700770:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.700821:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949440 00000100:00100000:2.0:1787864811.700831:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949440 00000100:00100000:2.0:1787864811.700913:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:2.0:1787864811.700924:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825949440:12345-192.168.206.36@tcp:1:lfs.0 00010000:00010000:2.0:1787864811.701164:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.701193:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.701202:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864811.701206:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864811.701218:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.701251:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.701266:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 6 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864811.701279:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844884736:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864811.701471:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864811.704267:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a970c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8423:1874711844884736:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864811.704295:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864811.704688:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.705825:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949568 00000100:00100000:2.0:1787864811.705981:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949568 00002000:00100000:2.0:1787864811.706034:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff927547a28780 x1874711825949568/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:662/0 lens 504/0 e 0 to 0 dl 1787864822 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864811.706045:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927547a28780 with x1874711825949568 ext(0->12) 00010000:00010000:2.0:1787864811.706054:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 7 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.706072:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 7 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864811.706093:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff927547a28780 00000100:00100000:2.0:1787864811.706172:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:2.0:1787864811.706182:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825949568:12345-192.168.206.36@tcp:4:lfs.0 00000100:00100000:2.0:1787864811.707158:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a28780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825949568:12345-192.168.206.36@tcp:4:lfs.0 Request processed in 974us (2468us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787864811.707169:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00002000:00100000:2.0:1787864811.707177:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff927547a28780 x1874711825949568/t4294967306(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:662/0 lens 504/448 e 0 to 0 dl 1787864822 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787864811.707186:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927547a28780 with x1874711825949568 ext(0->12) 00010000:00010000:2.0:1787864811.707194:0:8431:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.707207:0:8431:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864811.707214:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff927547a28780 00000100:00100000:2.0:1787864811.712140:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.712295:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949696 00000100:00100000:1.0:1787864811.712305:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949696 00010000:00010000:1.0:1787864811.712341:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864811.712403:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 82 00000100:00100000:1.0:1787864811.712415:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825949696:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864811.712431:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787864811.712449:0:6497:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787864811.712452:0:6497:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787864811 00002000:00010000:1.0:1787864811.712454:0:6497:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787864811 00002000:00010000:1.0:1787864811.712456:0:6497:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787864811 00002000:00010000:1.0:1787864811.712458:0:6497:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787864811.712465:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.712479:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.712502:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc43d40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb3f expref: 9 pid: 14166 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.712519:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864811.712523:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864811.712528:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.712538:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.712583:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864811.712651:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825949696:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 226us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.712660:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 82 00010000:00010000:0.0:1787864811.715003:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715022:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715052:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715062:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715070:0:8423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715077:0:8423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864811.715081:0:8423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715089:0:8423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715121:0:8423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.715128:0:8423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000447ad984/0x2fcb8c294dc43d8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864811.715231:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825949440:12345-192.168.206.36@tcp:1:lfs.0 Request processed in 14305us (14465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864811.715241:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:2.0:1787864811.720690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.726453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825949952 00000100:00100000:0.0:1787864811.726467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825949952 00000100:00100000:1.0:1787864811.726756:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:1.0:1787864811.726768:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12242:x1874711825949952:12345-192.168.206.36@tcp:35:lfs.0 00000004:00010000:1.0:1787864811.726830:0:6514:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb5b expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864811.727034:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1787864811.727069:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787864811.728497:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1787864811.728551:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.728569:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 31 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.728579:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.728614:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 31 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.728631:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 31 pid: 6510 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864811.728676:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274489a2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1874711844884864:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864811.728840:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864811.737282:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274489a2580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6514:1874711844884864:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864811.737313:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864811.737529:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.738154:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825950080 00000100:00100000:1.0:1787864811.738164:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825950080 00010000:00010000:1.0:1787864811.738200:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 32 pid: 6510 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864811.738246:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 83 00000100:00100000:1.0:1787864811.738256:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+32:2410:x1874711825950080:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864811.738271:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864811.738277:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 32 pid: 6510 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738289:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 32 pid: 6510 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738312:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43d2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb31 expref: 32 pid: 6510 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738331:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:1.0:1787864811.738337:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738363:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738370:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864811.738403:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864811.738472:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+31:2410:x1874711825950080:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 218us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864811.738480:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 83 00010000:00010000:2.0:1787864811.739308:0:6514:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.739318:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864811.739432:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1787864811.739535:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787864811.739611:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844884992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787864811.739673:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864811.739758:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864811.741292:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844884992 00000100:00100000:3.0:1787864811.741303:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844884992 00000100:00100000:3.0:1787864811.741363:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787864811.741371:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844884992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787864811.741546:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844884992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 176us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864811.741554:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787864811.741622:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844884992:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787864811.741771:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1787864811.741834:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844885120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787864811.741867:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864811.742074:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864811.742224:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844885120 00000100:00100000:3.0:1787864811.742229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844885120 00000100:00100000:3.0:1787864811.742308:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787864811.742316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6514:x1874711844885120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787864811.742424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6514:x1874711844885120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (555us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787864811.742431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787864811.742485:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6514:1874711844885120:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787864811.742527:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787864811.742558:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742568:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742575:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742581:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864811.742585:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742592:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742621:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:2.0:1787864811.742624:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787864811.742629:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.742635:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43d94 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864811.742731:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787864811.742785:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787864811.742795:0:6514:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336804905914ns, next at 337804903730ns, rc = 0 00000001:00080000:2.0:1787864811.742802:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1787864811.742824:0:6514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927448159d00) 00010000:00010000:2.0:1787864811.742827:0:6514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787864811.742833:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43d7f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb5b expref: 35 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864811.743097:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+34:12242:x1874711825949952:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 16329us (22413us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1787864811.743105:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 38 00000020:00080000:2.0:1787864811.743109:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787864811.746633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864811.746755:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825950208 00000100:00100000:3.0:1787864811.746765:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825950208 00000100:00100000:3.0:1787864811.746880:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 162 00000100:00100000:3.0:1787864811.746910:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+34:12242:x1874711825950208:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864811.746945:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864811.746969:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb62 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.747049:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb62 expref: 35 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.747065:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb62 expref: 35 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864811.747084:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864811.747087:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864811.747092:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f400, rc 0) 00000100:00100000:3.0:1787864811.747159:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+35:12242:x1874711825950208:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 269us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864811.747166:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 162 00000100:00100000:0.0:1787864811.755410:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.755547:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825950464 00000100:00100000:2.0:1787864811.755557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825950464 00000100:00100000:2.0:1787864811.755616:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:2.0:1787864811.755626:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+35:12242:x1874711825950464:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864811.756091:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+36:12242:x1874711825950464:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 231us (454us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787864811.756114:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:3.0:1787864811.801266:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864811.801291:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844885248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864811.801359:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864811.801495:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844885248 00000100:00100000:0.0:1787864811.801503:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844885248 00000100:00100000:0.0:1787864811.801551:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787864811.801560:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844885248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864811.801593:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864811.801647:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844885248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864811.801655:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787864811.802133:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844885248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864811.859182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.861127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825950720 00000100:00100000:2.0:1787864811.861139:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825950720 00000100:00100000:2.0:1787864811.861213:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 163 00000100:00100000:2.0:1787864811.861223:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+36:12252:x1874711825950720:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864811.861245:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864811.861265:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43da2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb69 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864811.861357:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787864811.861452:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43da2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb69 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.861467:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:2.0:1787864811.861471:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864811.861477:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43da2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb69 expref: 38 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.861492:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864811.861564:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12252:x1874711825950720:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 342us (2390us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787864811.861571:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 163 00000100:00100000:3.0:1787864811.865869:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.866012:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825950848 00000100:00100000:0.0:1787864811.866022:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825950848 00000100:00100000:0.0:1787864811.866083:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 164 00000100:00100000:0.0:1787864811.866093:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12252:x1874711825950848:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:0.0:1787864811.866174:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866206:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866228:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866241:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866249:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866396:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.866404:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864811.866466:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866476:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866484:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864811.866527:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866540:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866548:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866566:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866572:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.866577:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866585:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866598:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864811.866601:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.866606:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866613:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43db0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866626:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866632:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866639:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866644:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.866647:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866663:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866672:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:0.0:1787864811.866674:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.866678:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866684:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43db7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866693:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866700:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866719:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866725:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.866728:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866735:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866742:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864811.866745:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.866748:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.866765:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864811.866887:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927547a292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12252:x1874711825950848:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 793us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864811.866925:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 164 00000100:00100000:0.0:1787864811.870672:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.870767:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825951104 00000100:00100000:2.0:1787864811.870776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825951104 00000100:00100000:2.0:1787864811.870920:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:2.0:1787864811.870932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12252:x1874711825951104:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864811.871157:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+38:12252:x1874711825951104:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 227us (493us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787864811.871166:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:1.0:1787864811.940599:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864811.940763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825951360 00000100:00100000:0.0:1787864811.940772:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825951360 00000100:00100000:0.0:1787864811.940835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 165 00000100:00100000:0.0:1787864811.940846:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:12255:x1874711825951360:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864811.940868:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864811.940926:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dc5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb70 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.940998:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941013:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941025:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941036:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941044:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941066:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941169:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941176:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941183:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864811.941192:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787864811.941253:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941260:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941401:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941406:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.941411:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941419:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941430:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864811.941433:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.941445:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941450:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43dcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941462:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941468:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941473:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941478:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864811.941481:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941486:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941494:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:0.0:1787864811.941496:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864811.941499:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941504:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43dd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941541:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43dc5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941567:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864811.941573:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864811.941576:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864811.941578:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864811.943462:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12255:x1874711825951360:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 803us (1060us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787864811.943476:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 165 00000100:00100000:3.0:1787864811.950029:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864811.950510:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825951488 00000100:00100000:2.0:1787864811.950518:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825951488 00000100:00100000:2.0:1787864811.950574:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 166 00000100:00100000:2.0:1787864811.950583:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12255:x1874711825951488:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864811.950640:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950656:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950667:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950697:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950713:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950720:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950726:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864811.950730:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950738:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950763:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864811.950765:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864811.950770:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864811.950777:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864811.950842:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12255:x1874711825951488:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 259us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864811.950849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 166 00000100:00100000:3.0:1787864811.954916:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864811.955107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825951744 00000100:00100000:1.0:1787864811.955127:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825951744 00000100:00100000:1.0:1787864811.955183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:1.0:1787864811.955193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12255:x1874711825951744:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:1.0:1787864811.955523:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+41:12255:x1874711825951744:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 331us (633us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787864811.955532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:1.0:1787864812.228721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864812.229519:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952000 00000100:00100000:2.0:1787864812.229528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952000 00000100:00100000:2.0:1787864812.229649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 167 00000100:00100000:2.0:1787864812.229661:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+41:12286:x1874711825952000:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:2.0:1787864812.229685:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864812.229715:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43def lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb77 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.229825:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.229841:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.229852:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864812.229863:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787864812.230022:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43def lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb77 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.230041:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb77 expref: 43 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.230051:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864812.230055:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864812.230059:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:2.0:1787864812.230135:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12286:x1874711825952000:12345-192.168.206.36@tcp:101:cat.0 Request processed in 477us (1433us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787864812.230144:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 167 00000100:00100000:3.0:1787864812.234694:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864812.234864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952256 00000100:00100000:1.0:1787864812.234880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952256 00000100:00100000:1.0:1787864812.235086:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:1.0:1787864812.235096:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12286:x1874711825952256:12345-192.168.206.36@tcp:35:cat.0 00000100:00100000:1.0:1787864812.235332:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+44:12286:x1874711825952256:12345-192.168.206.36@tcp:35:cat.0 Request processed in 237us (647us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1787864812.235354:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:3.0:1787864812.242492:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864812.242650:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952384 00000100:00100000:1.0:1787864812.242659:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952384 00000100:00100000:1.0:1787864812.242743:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:1.0:1787864812.242754:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927566f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+44:2410:x1874711825952384:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864812.242769:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864812.243372:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43df6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb77 expref: 44 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864812.243393:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:1.0:1787864812.243397:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864812.243452:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927566f6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+43:2410:x1874711825952384:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 701us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864812.243460:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:0.0:1787864812.295453:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864812.298193:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952640 00000100:00100000:3.0:1787864812.298337:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952640 00000100:00100000:3.0:1787864812.298608:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 168 00000100:00100000:3.0:1787864812.298618:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12292:x1874711825952640:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:3.0:1787864812.298656:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864812.298660:0:13804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787864812.298696:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43d5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb4d expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.298727:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864812.298732:0:13804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864812.298745:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e04 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb7e expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.299066:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.299081:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.299090:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.299120:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 43 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.299134:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 43 pid: 6511 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864812.299147:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af7840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844885376:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864812.299256:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864812.304014:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864812.304243:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af7840 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844885376:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864812.304278:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864812.304432:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952768 00000100:00100000:2.0:1787864812.304440:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952768 00010000:00010000:2.0:1787864812.304474:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 44 pid: 6511 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864812.304510:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 84 00000100:00100000:2.0:1787864812.304519:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+44:2409:x1874711825952768:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864812.304544:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864812.304551:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 44 pid: 6511 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304563:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 44 pid: 6511 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304584:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43dda lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb70 expref: 44 pid: 6511 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304611:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864812.304616:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304625:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304633:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.304662:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864812.304727:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+43:2409:x1874711825952768:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 208us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864812.304734:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 84 00010000:00010000:3.0:1787864812.305619:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.305631:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864812.305653:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787864812.305837:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 44 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.305856:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 43 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.305864:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864812.305877:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864812.305881:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e200, rc 0) 00000100:00100000:3.0:1787864812.307190:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12292:x1874711825952640:12345-192.168.206.36@tcp:101:dd.0 Request processed in 8566us (11739us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787864812.307201:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 168 00000100:00100000:3.0:1787864812.313862:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844885632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864812.314089:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864812.314112:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844885504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864812.314968:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864812.315032:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864812.315093:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844885632 00000100:00100000:0.0:1787864812.315101:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844885632 00000100:00100000:0.0:1787864812.315169:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787864812.315180:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844885632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864812.315202:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864812.315277:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1874711844885632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864812.315284:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1787864812.315313:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864812.315380:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844885632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864812.315459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864812.315696:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844885504 00000100:00100000:3.0:1787864812.315711:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844885504 00000100:00100000:3.0:1787864812.315770:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787864812.315778:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844885504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864812.315790:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864812.315831:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844885504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864812.315852:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1787864812.315983:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864812.316115:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a97840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844885504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864812.316387:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825952896 00000100:00100000:0.0:1787864812.316392:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825952896 00000100:00100000:0.0:1787864812.316434:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 169 00000100:00100000:0.0:1787864812.316442:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12292:x1874711825952896:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:0.0:1787864812.316458:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864812.316491:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb85 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316535:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316548:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316560:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316662:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316679:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.316687:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.316690:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864812.316693:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb400, rc 0) 00000100:00100000:0.0:1787864812.316766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+44:12292:x1874711825952896:12345-192.168.206.36@tcp:101:dd.0 Request processed in 322us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864812.316773:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 169 00000100:00100000:1.0:1787864812.319800:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864812.319964:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825953152 00000100:00100000:0.0:1787864812.319983:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825953152 00000100:00100000:0.0:1787864812.320040:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 170 00000100:00100000:0.0:1787864812.320049:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+44:12292:x1874711825953152:12345-192.168.206.36@tcp:36:dd.0 00010000:00010000:0.0:1787864812.320252:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.320464:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.320477:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864812.320523:0:8448:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1787864812.320548:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0f0341e reply state 00000000e1a77aec transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.320560:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.320568:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.320571:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864812.320575:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864812.320672:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+47:12292:x1874711825953152:12345-192.168.206.36@tcp:36:dd.0 Request processed in 623us (878us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787864812.320679:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 170 00000020:00080000:0.0:1787864812.320684:0:8448:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787864812.619860:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864812.620044:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825953280 00000100:00100000:0.0:1787864812.620054:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825953280 00000100:00100000:0.0:1787864812.620115:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 171 00000100:00100000:0.0:1787864812.620125:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+47:12306:x1874711825953280:12345-192.168.206.36@tcp:101:stat.0 00010000:00010000:0.0:1787864812.620147:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864812.620168:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb8c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620240:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620267:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620280:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620293:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620301:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620306:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620371:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620382:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 48 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620391:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620421:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 48 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.620434:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 48 pid: 13804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864812.620459:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844885760:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864812.620558:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864812.633021:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844885760:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864812.633053:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864812.636018:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864812.636233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825953536 00000100:00100000:3.0:1787864812.636242:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825953536 00000100:00100000:3.0:1787864812.636299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864812.636309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+49:6197:x1874711825953536:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787864812.636581:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+50:6197:x1874711825953536:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 273us (571us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787864812.636589:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864812.641232:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864812.642129:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825953664 00000100:00100000:2.0:1787864812.642139:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825953664 00010000:00010000:2.0:1787864812.642411:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 50 pid: 13804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864812.642459:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 85 00000100:00100000:2.0:1787864812.642470:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+50:2410:x1874711825953664:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864812.642496:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864812.642504:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 50 pid: 13804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642536:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 50 pid: 13804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642560:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc43e0b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb7e expref: 50 pid: 13804 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642578:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864812.642584:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642593:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642601:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.642645:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864812.642688:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642711:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864812.642714:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+49:2410:x1874711825953664:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 246us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864812.642730:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 85 00000004:00200000:0.0:1787864812.642768:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787864812.642772:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864812.642791:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642804:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642813:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642819:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642825:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642830:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbe00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864812.642840:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642944:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642957:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864812.642960:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864812.642964:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642969:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642980:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642985:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642991:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.642996:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864812.642999:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643005:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643012:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:0.0:1787864812.643026:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864812.643038:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643044:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643075:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb8c expref: 49 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643088:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb8c expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.643094:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.643097:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864812.643099:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bac00, rc 0) 00000100:00100000:0.0:1787864812.643423:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+48:12306:x1874711825953280:12345-192.168.206.36@tcp:101:stat.0 Request processed in 23297us (23575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864812.643430:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 171 00000100:00100000:3.0:1787864812.700645:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864812.701158:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825953920 00000100:00100000:0.0:1787864812.701168:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825953920 00000100:00100000:0.0:1787864812.702219:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 172 00000100:00100000:0.0:1787864812.702234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+48:12312:x1874711825953920:12345-192.168.206.36@tcp:36:truncate.0 00010000:00010000:0.0:1787864812.702289:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864812.702314:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb8c expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.702332:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.702336:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864812.702508:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.702522:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.702532:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864812.702573:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1787864812.702605:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000425b1370 reply state 00000000e47732b7 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.702619:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.702625:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.702627:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864812.702630:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864812.702756:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+50:12312:x1874711825953920:12345-192.168.206.36@tcp:36:truncate.0 Request processed in 526us (2118us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787864812.702763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 172 00000020:00080000:0.0:1787864812.702767:0:6510:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787864812.824355:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864812.824437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825954048 00000100:00100000:2.0:1787864812.824450:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825954048 00000100:00100000:2.0:1787864812.824585:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 173 00000100:00100000:2.0:1787864812.824598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+50:12326:x1874711825954048:12345-192.168.206.36@tcp:101:stat.0 00010000:00010000:2.0:1787864812.824629:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864812.824654:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43e51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb93 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824773:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824791:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824805:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824818:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824825:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824831:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824954:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824963:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.824970:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864812.825018:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787864812.825024:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864812.825046:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825072:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825080:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825086:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825093:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825100:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864812.825104:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825112:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825126:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864812.825130:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864812.825135:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825142:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43e58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825158:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825164:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825177:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825323:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864812.825328:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825335:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825344:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:2.0:1787864812.825346:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864812.825349:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825355:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43e5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825388:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc43e51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 52 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825403:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 51 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864812.825411:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864812.825413:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864812.825416:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:2.0:1787864812.825528:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+51:12326:x1874711825954048:12345-192.168.206.36@tcp:101:stat.0 Request processed in 932us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864812.825545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 173 00010000:00010000:3.0:1787864812.892807:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864812.905847:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864812.906018:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825954304 00000100:00100000:3.0:1787864812.906028:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825954304 00000100:00100000:3.0:1787864812.906094:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 174 00000100:00100000:3.0:1787864812.906105:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+51:12336:x1874711825954304:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864812.906124:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864812.906145:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acb9a expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864812.906248:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787864812.906538:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb9a expref: 53 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.906553:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864812.906556:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864812.906561:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb9a expref: 53 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.906586:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e600, rc 0) 00000100:00100000:3.0:1787864812.906762:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+52:12336:x1874711825954304:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 657us (922us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1787864812.906770:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 174 00000100:00100000:3.0:1787864812.911772:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864812.912048:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825954560 00000100:00100000:2.0:1787864812.912057:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825954560 00000100:00100000:2.0:1787864812.912112:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:2.0:1787864812.912121:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+52:12336:x1874711825954560:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864812.912563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+53:12336:x1874711825954560:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 440us (798us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787864812.912572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:1.0:1787864812.987351:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864812.987606:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825954816 00000100:00100000:3.0:1787864812.987618:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825954816 00000100:00100000:3.0:1787864812.987694:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 175 00000100:00100000:3.0:1787864812.987721:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+53:12342:x1874711825954816:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864812.987755:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864812.987782:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e7b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acba1 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.987958:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.987974:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.987986:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.988026:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 54 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.988042:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 54 pid: 6512 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864812.988082:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844885888:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864812.988425:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864812.991517:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864812.992003:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825954944 00000100:00100000:0.0:1787864812.992015:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825954944 00010000:00010000:0.0:1787864812.992070:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 55 pid: 6512 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864812.992181:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 86 00000100:00100000:0.0:1787864812.992194:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+55:2410:x1874711825954944:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864812.992222:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864812.992248:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 55 pid: 6512 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.992263:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 55 pid: 6512 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.992295:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.992301:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.992312:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.992320:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.992342:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864812.992417:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+55:2410:x1874711825954944:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 225us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864812.992426:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 86 00010000:00010000:3.0:1787864812.993175:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc43e66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb93 expref: 54 pid: 6512 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864812.993201:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844885888:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864812.993239:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.993250:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.993256:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864812.993276:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787864812.993446:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43e7b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 55 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.993463:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 54 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864812.993471:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864812.993475:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864812.993478:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e800, rc 0) 00000100:00100000:3.0:1787864812.993547:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+54:12342:x1874711825954816:12345-192.168.206.36@tcp:101:bash.0 Request processed in 5828us (6209us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787864812.993571:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 175 00000100:00100000:1.0:1787864812.996564:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864812.996770:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825955200 00000100:00100000:0.0:1787864812.996782:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825955200 00000100:00100000:0.0:1787864812.996860:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 176 00000100:00100000:0.0:1787864812.996871:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+54:12342:x1874711825955200:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:0.0:1787864812.997294:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.997315:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.997327:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864812.997380:0:8448:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1787864812.997400:0:8448:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd333b69 reply state 00000000cde77e1c transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.997794:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864812.997803:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864812.997806:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864812.997809:0:8448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864812.997950:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+57:12342:x1874711825955200:12345-192.168.206.36@tcp:36:bash.0 Request processed in 1079us (1397us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1787864812.997959:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 176 00000020:00080000:0.0:1787864812.997965:0:8448:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787864813.005377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.005534:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825955328 00000100:00100000:0.0:1787864813.005546:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825955328 00000100:00100000:0.0:1787864813.005640:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 177 00000100:00100000:0.0:1787864813.005652:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+57:12342:x1874711825955328:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864813.005682:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1787864813.005803:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864813.005851:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acba8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.006009:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.006432:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 58 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.006469:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.006515:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 58 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.006533:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 58 pid: 10168 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864813.006550:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844886016:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864813.006726:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864813.010807:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.010962:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844886016:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864813.010998:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864813.011688:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825955456 00000100:00100000:2.0:1787864813.011715:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825955456 00010000:00010000:2.0:1787864813.011766:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 59 pid: 10168 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864813.011817:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 87 00000100:00100000:2.0:1787864813.011828:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+59:2410:x1874711825955456:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864813.011847:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864813.011855:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 59 pid: 10168 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.011882:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 59 pid: 10168 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.011946:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc43e82 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba1 expref: 59 pid: 10168 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.011989:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864813.011994:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.012005:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.012336:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.012378:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864813.012455:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+58:2410:x1874711825955456:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 628us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.012465:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 87 00010000:00010000:0.0:1787864813.012543:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.012553:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.012623:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787864813.012628:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864813.012653:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.012690:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43e97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba8 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.012738:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba8 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.012746:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.012749:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864813.012752:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbe00, rc 0) 00000100:00100000:0.0:1787864813.012781:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+57:12342:x1874711825955328:12345-192.168.206.36@tcp:101:bash.0 Request processed in 7132us (7418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.012788:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 177 00000100:00100000:1.0:1787864813.016435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.016548:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825955712 00000100:00100000:2.0:1787864813.016561:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825955712 00000100:00100000:2.0:1787864813.016665:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:2.0:1787864813.016677:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+57:12342:x1874711825955712:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:2.0:1787864813.017763:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12342:x1874711825955712:12345-192.168.206.36@tcp:35:bash.0 Request processed in 1079us (1332us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787864813.017776:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:1.0:1787864813.084938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.085766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825955968 00000100:00100000:0.0:1787864813.085776:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825955968 00000100:00100000:0.0:1787864813.085954:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 178 00000100:00100000:0.0:1787864813.085967:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12352:x1874711825955968:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864813.085991:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.086012:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbaf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.086106:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787864813.086200:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ea5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbaf expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.086214:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:0.0:1787864813.086217:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864813.086223:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbaf expref: 60 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.086267:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:0.0:1787864813.086338:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12352:x1874711825955968:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 374us (1408us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787864813.086346:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 178 00000100:00100000:1.0:1787864813.092550:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.092813:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956096 00000100:00100000:2.0:1787864813.092825:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956096 00000100:00100000:2.0:1787864813.092923:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 179 00000100:00100000:2.0:1787864813.092934:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12352:x1874711825956096:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:2.0:1787864813.093032:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093071:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093085:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093099:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093106:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093113:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093204:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093214:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093221:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864813.093283:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093299:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093306:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093323:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093330:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.093335:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093344:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093358:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864813.093361:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864813.093367:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093373:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43eb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093394:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093400:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093406:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093412:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.093484:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093502:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093512:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:2.0:1787864813.093515:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864813.093518:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093525:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc43eba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093536:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093542:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093549:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093554:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.093556:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093562:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093569:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864813.093571:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864813.093574:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.093589:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43ec1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864813.093692:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12352:x1874711825956096:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 757us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.094608:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 179 00000100:00100000:1.0:1787864813.099964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.100061:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956352 00000100:00100000:3.0:1787864813.100074:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956352 00000100:00100000:3.0:1787864813.100141:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:3.0:1787864813.100152:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12352:x1874711825956352:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:3.0:1787864813.100435:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:12352:x1874711825956352:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 282us (481us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787864813.100443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:1.0:1787864813.149766:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.149818:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.149859:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.149938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.149939:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956864 00000100:00100000:0.0:1787864813.149952:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956864 00000100:00100000:1.0:1787864813.149969:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.149993:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956736 00000100:00100000:1.0:1787864813.149998:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956736 00000100:00100000:1.0:1787864813.150043:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 112 00000100:00100000:1.0:1787864813.150055:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825956736:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864813.150061:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956480 00000100:00100000:3.0:1787864813.150067:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956480 00000100:00100000:2.0:1787864813.150077:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956608 00000100:00100000:2.0:1787864813.150084:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956608 00000100:00100000:3.0:1787864813.150113:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 383 00000100:00100000:3.0:1787864813.150125:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825956480:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864813.150125:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825957120 00000100:00100000:2.0:1787864813.150130:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825957120 00000100:00100000:2.0:1787864813.150162:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 287 00000100:00100000:2.0:1787864813.150171:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825956608:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864813.150379:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274489bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825956736:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 324us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864813.150388:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 112 00000100:00100000:1.0:1787864813.150407:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:1.0:1787864813.150414:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825956864:12345-192.168.206.36@tcp:400:kworker.0 00000100:00080000:0.0:1787864813.151948:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864813.151960:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864813.151963:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864813.152110:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 288 00000100:00100000:0.0:1787864813.152133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825957120:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864813.153496:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2409:x1874711825956480:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 3362us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.153518:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 383 00000100:00100000:3.0:1787864813.156052:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.156273:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2410:x1874711825956608:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 6099us (6449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.156289:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 287 00000100:00100000:2.0:1787864813.156325:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825956992 00000100:00100000:2.0:1787864813.156334:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825956992 00000100:00100000:1.0:1787864813.156369:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2410:x1874711825956864:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 5951us (6505us total) trans 0 rc 0/0 00000100:00080000:2.0:1787864813.156378:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864813.156391:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:2.0:1787864813.156423:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 289 00000100:00100000:2.0:1787864813.156435:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825956992:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864813.156514:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2409:x1874711825956992:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.156521:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 289 00000100:00100000:3.0:1787864813.159104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.161450:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2410:x1874711825957120:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 9304us (11487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.161468:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 288 00000100:00100000:0.0:1787864813.161513:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825957376 00000100:00100000:0.0:1787864813.161523:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825957376 00000100:00100000:0.0:1787864813.161598:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:0.0:1787864813.161608:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:12355:x1874711825957376:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864813.161636:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.161661:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ec8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbb6 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161760:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161778:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161823:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161838:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161849:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.161857:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162002:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43edd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162012:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162020:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.162043:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787864813.162144:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162152:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162159:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162165:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bba00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864813.162176:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162185:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162198:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864813.162201:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864813.162206:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162213:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43ecf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162228:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162235:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162241:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162246:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864813.162249:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162255:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162263:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:0.0:1787864813.162265:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864813.162275:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162281:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43ed6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162401:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ec8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbb6 expref: 63 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162416:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbb6 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.162423:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.162425:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864813.162428:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb600, rc 0) 00000100:00100000:0.0:1787864813.162495:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+62:12355:x1874711825957376:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 889us (3464us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787864813.162502:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 180 00000100:00100000:1.0:1787864813.175734:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.175864:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825957504 00000100:00100000:2.0:1787864813.175876:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825957504 00000100:00100000:2.0:1787864813.175990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00100000:2.0:1787864813.176024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+62:12355:x1874711825957504:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864813.176112:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176133:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176145:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176185:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176193:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176200:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176207:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.176212:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176222:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176234:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864813.176237:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864813.176242:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.176249:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43eeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864813.176346:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+62:12355:x1874711825957504:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 339us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.176355:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 181 00000100:00100000:1.0:1787864813.178959:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.181035:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825957632 00000100:00100000:0.0:1787864813.181052:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825957632 00000100:00100000:0.0:1787864813.181150:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:0.0:1787864813.181164:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+62:2408:x1874711825957632:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864813.181185:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864813.181219:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbb6 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.181242:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.181248:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864813.181350:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+61:2408:x1874711825957632:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 189us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.181360:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:1.0:1787864813.181454:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.181563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825957888 00000100:00100000:2.0:1787864813.181568:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825957888 00000100:00100000:2.0:1787864813.181613:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:2.0:1787864813.181621:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+61:12355:x1874711825957888:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864813.181865:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+62:12355:x1874711825957888:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 245us (412us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787864813.181872:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:1.0:1787864813.329298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.329961:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825958144 00000100:00100000:0.0:1787864813.329976:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825958144 00000100:00100000:0.0:1787864813.330065:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00100000:0.0:1787864813.330077:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+62:12373:x1874711825958144:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:0.0:1787864813.330109:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.330136:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43ef2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbbd expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.330270:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ef9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.330286:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.330301:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.330314:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787864813.330441:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43ef2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbbd expref: 65 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.330461:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbbd expref: 64 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.330470:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.330473:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787864813.330493:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:0.0:1787864813.330564:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12373:x1874711825958144:12345-192.168.206.36@tcp:101:cat.0 Request processed in 489us (1279us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787864813.330573:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 182 00000100:00100000:0.0:1787864813.337317:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864813.337346:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844886144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864813.337445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864813.337579:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844886144 00000100:00100000:3.0:1787864813.337588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844886144 00000100:00100000:3.0:1787864813.337651:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787864813.337660:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844886144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864813.337714:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787864813.337779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844886144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.337788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787864813.337984:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844886144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864813.352615:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.352742:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825958272 00000100:00100000:0.0:1787864813.352754:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825958272 00000100:00100000:0.0:1787864813.352838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 183 00000100:00100000:0.0:1787864813.352850:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12374:x1874711825958272:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864813.352880:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.353594:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbc4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353682:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353712:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353727:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.353779:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1787864813.353783:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864813.353806:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353838:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbc4 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353978:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbc4 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.353988:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864813.353991:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864813.353995:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864813.354089:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12374:x1874711825958272:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1241us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.354098:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 183 00000100:00100000:1.0:1787864813.357740:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.357930:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825958656 00000100:00100000:2.0:1787864813.357943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825958656 00000100:00100000:0.0:1787864813.358095:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 48 00000100:00100000:0.0:1787864813.358109:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12374:x1874711825958656:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864813.358487:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12374:x1874711825958656:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 380us (757us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787864813.358495:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 48 00000100:00100000:1.0:1787864813.361581:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.361717:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825958784 00000100:00100000:2.0:1787864813.361728:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825958784 00000100:00100000:3.0:1787864813.361885:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:3.0:1787864813.361915:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12374:x1874711825958784:12345-192.168.206.36@tcp:103:lfs.0 00010000:00010000:3.0:1787864813.361933:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787864813.361962:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc43e9e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acba8 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.361983:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc43ef9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbbd expref: 65 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.361994:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43d9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb62 expref: 64 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.362004:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864813.362019:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864813.362089:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12374:x1874711825958784:12345-192.168.206.36@tcp:103:lfs.0 Request processed in 177us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.362097:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:3.0:1787864813.364561:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.364674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825958912 00000100:00100000:2.0:1787864813.364685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825958912 00000100:00100000:2.0:1787864813.364831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 184 00000100:00100000:2.0:1787864813.364844:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12374:x1874711825958912:12345-192.168.206.36@tcp:58:lfs.0 00010000:00010000:2.0:1787864813.365046:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.365068:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.365082:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864813.365215:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787864813.365328:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12374:x1874711825958912:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 487us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.365338:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 184 00000100:00100000:1.0:1787864813.391299:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.391403:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959040 00000100:00100000:0.0:1787864813.391415:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959040 00000100:00100000:0.0:1787864813.391493:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 185 00000100:00100000:0.0:1787864813.391504:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12376:x1874711825959040:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864813.391530:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.391556:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43f1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbcb expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391637:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391678:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391692:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391719:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391727:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391734:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391822:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391831:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391838:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.391934:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787864813.391939:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864813.391962:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391977:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.391997:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392003:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392009:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392016:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bba00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864813.392022:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392030:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392044:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864813.392047:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864813.392053:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392060:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392075:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392081:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392088:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392099:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864813.392103:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392109:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392119:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:0.0:1787864813.392122:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864813.392125:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392132:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392162:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43f1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 65 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392177:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 64 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.392468:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.392471:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864813.392474:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba400, rc 0) 00000100:00100000:0.0:1787864813.392775:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12376:x1874711825959040:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1270us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.392784:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 185 00000040:00080000:1.0:1787864813.724219:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864813.724232:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864813.724265:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787864813.724275:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864813.724521:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844886272:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787864813.724702:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864813.733805:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844886272:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864813.734104:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.734430:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959168 00000100:00100000:3.0:1787864813.734441:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959168 00000100:00100000:3.0:1787864813.734514:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 186 00000100:00100000:3.0:1787864813.734526:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12387:x1874711825959168:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787864813.734565:0:10168:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787864813.734710:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12387:x1874711825959168:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 186us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.734731:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 186 00000100:00100000:2.0:1787864813.744119:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.744282:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959296 00000100:00100000:1.0:1787864813.744295:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959296 00000100:00100000:1.0:1787864813.744379:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 187 00000100:00100000:1.0:1787864813.744391:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12387:x1874711825959296:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787864813.744483:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744504:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744518:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744730:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744797:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744810:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744850:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744860:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.744867:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864813.745266:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787864813.745272:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864813.745287:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745299:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745305:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745311:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745335:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864813.745340:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745348:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745361:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864813.745364:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864813.745369:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745375:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745391:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745396:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745402:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745407:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864813.745410:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745416:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745435:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff927447234b00) 00010000:00010000:1.0:1787864813.745438:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864813.745441:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745523:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc43f3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745538:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745544:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745550:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745556:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864813.745558:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745564:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.745573:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:1.0:1787864813.745575:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864813.745579:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.746545:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43f46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864813.746664:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12387:x1874711825959296:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 Request processed in 2272us (2557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864813.746674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 187 00000100:00100000:2.0:1787864813.756096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.756301:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959552 00000100:00100000:0.0:1787864813.756380:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959552 00000100:00100000:0.0:1787864813.756488:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 188 00000100:00100000:0.0:1787864813.756501:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12387:x1874711825959552:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864813.756525:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.756550:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f4d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbd2 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756701:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756719:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756731:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.756745:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787864813.756842:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756851:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756858:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756864:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bba00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864813.756869:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756877:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756925:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:0.0:1787864813.756928:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787864813.756934:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756940:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43f54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756984:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f4d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbd2 expref: 66 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.756995:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:0.0:1787864813.756997:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864813.757001:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc43f4d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbd2 expref: 66 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.757010:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba600, rc 0) 00000100:00100000:0.0:1787864813.757085:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448af6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825959552:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 587us (1002us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1787864813.757093:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 188 00000100:00100000:1.0:1787864813.764141:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.764411:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959680 00000100:00100000:3.0:1787864813.764423:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959680 00000100:00100000:3.0:1787864813.764575:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:3.0:1787864813.764588:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825959680:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787864813.764786:0:10168:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787864813.765499:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825959680:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 907us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.765512:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 189 00000100:00100000:1.0:1787864813.772827:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.772969:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825959936 00000100:00100000:3.0:1787864813.772990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825959936 00000100:00100000:3.0:1787864813.773063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:3.0:1787864813.773074:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825959936:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864813.773111:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864813.773116:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787864813.773484:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc43f0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbc4 expref: 65 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.773507:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864813.773513:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864813.773531:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbd9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787864813.776530:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787864813.777484:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43f69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.777528:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.777542:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43f69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.777636:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbd9 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.777657:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43f69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbd9 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.777668:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1a00) 00010000:00010000:3.0:1787864813.777670:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864813.777675:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e600, rc 0) 00000100:00100000:3.0:1787864813.777950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12387:x1874711825959936:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 4875us (5134us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787864813.777961:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 190 00000100:00100000:3.0:1787864813.786008:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.786445:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825960192 00000100:00100000:2.0:1787864813.786459:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825960192 00000100:00100000:2.0:1787864813.786548:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:2.0:1787864813.786562:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12387:x1874711825960192:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864813.786638:0:8448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864813.786686:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc43f69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbd9 expref: 66 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786718:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1a00) 00010000:00010000:2.0:1787864813.786731:0:8448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864813.786760:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786777:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786789:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786815:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786823:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786849:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786946:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786955:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786963:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786971:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.786975:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786984:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.786994:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864813.786997:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864813.787001:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787007:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43f77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787017:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787024:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787037:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787043:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864813.787047:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787054:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787069:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6784f731 (ffff927448159d00) 00010000:00010000:2.0:1787864813.787073:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864813.787077:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.787084:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc43f7e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6784f731 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864813.787202:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825960192:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 643us (1207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864813.787210:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 191 00000100:00100000:2.0:1787864813.789400:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.789746:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825960320 00000100:00100000:3.0:1787864813.789757:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825960320 00000100:00100000:3.0:1787864813.789842:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:3.0:1787864813.789853:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12387:x1874711825960320:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864813.789880:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864813.789934:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbe0 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.789999:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.790014:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.790026:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.790166:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 67 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.790186:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 66 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.790195:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:3.0:1787864813.790198:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787864813.790202:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ec00, rc 0) 00000100:00100000:3.0:1787864813.790279:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12387:x1874711825960320:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 428us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.790288:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 192 00000100:00100000:0.0:1787864813.801771:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.801985:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825960576 00000100:00100000:1.0:1787864813.801999:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825960576 00000100:00100000:1.0:1787864813.802073:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 193 00000100:00100000:1.0:1787864813.802084:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12387:x1874711825960576:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787864813.802521:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.802541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.802556:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787864813.802784:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787864813.802796:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338864905841ns, next at 339864902923ns, rc = 0 00000004:00010000:1.0:1787864813.802855:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066944918 reply state 00000000e4a3e8d0 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.802871:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.802911:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:1.0:1787864813.802915:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787864813.802929:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864813.803048:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12387:x1874711825960576:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 964us (1286us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787864813.803058:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 193 00000100:00100000:2.0:1787864813.808335:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.808420:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825960704 00000100:00100000:3.0:1787864813.808433:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825960704 00000100:00100000:3.0:1787864813.808512:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 194 00000100:00100000:3.0:1787864813.808525:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12387:x1874711825960704:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787864813.808554:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864813.808580:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbe7 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.808660:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 69 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.808677:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 69 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.808708:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:3.0:1787864813.808712:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864813.808717:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f400, rc 0) 00000100:00100000:3.0:1787864813.808799:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+69:12387:x1874711825960704:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 276us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.808806:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 194 00000100:00100000:2.0:1787864813.817225:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.817434:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825960832 00000100:00100000:0.0:1787864813.817447:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825960832 00000100:00100000:0.0:1787864813.817529:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:0.0:1787864813.817541:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+6:2409:x1874711825960832:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787864813.822802:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825960832:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 5249us (5577us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787864813.822836:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:0.0:1787864813.828734:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.828834:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961088 00000100:00100000:3.0:1787864813.828846:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961088 00000100:00100000:2.0:1787864813.829264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:2.0:1787864813.829282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+69:12387:x1874711825961088:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787864813.829603:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12387:x1874711825961088:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 326us (881us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787864813.829628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:3.0:1787864813.833471:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.833562:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961344 00000100:00100000:2.0:1787864813.833574:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961344 00000100:00100000:2.0:1787864813.833642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 195 00000100:00100000:2.0:1787864813.833652:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12387:x1874711825961344:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787864813.833806:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12387:x1874711825961344:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 155us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.833814:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 195 00000100:00100000:3.0:1787864813.841544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.841615:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961472 00000100:00100000:0.0:1787864813.841631:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961472 00000100:00100000:0.0:1787864813.841799:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 196 00000100:00100000:0.0:1787864813.841812:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12387:x1874711825961472:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864813.841839:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.841865:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43fa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbee expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.842964:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.842989:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.843003:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864813.843059:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787864813.843082:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.843126:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bae00/0x2fcb8c294dc43fa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbee expref: 72 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.843203:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbee expref: 71 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.843228:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:0.0:1787864813.843231:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787864813.843235:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bba00, rc 0) 00000100:00100000:0.0:1787864813.843384:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12387:x1874711825961472:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1574us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.843394:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 196 00000100:00100000:3.0:1787864813.848022:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.848113:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961600 00000100:00100000:0.0:1787864813.848130:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961600 00000100:00100000:0.0:1787864813.848811:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:0.0:1787864813.848826:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825961600:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864813.848851:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864813.848877:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbf5 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864813.848933:0:8426:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a6ed, blocks: 0x0 00010000:00010000:0.0:1787864813.848959:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=338s v=(0 0) 00010000:00010000:0.0:1787864813.848965:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864813.848977:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.849000:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 8 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.849016:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bae00, rc 0) 00000100:00100000:0.0:1787864813.849105:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825961600:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 283us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.849113:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:3.0:1787864813.858118:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864813.863399:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961856 00000100:00100000:0.0:1787864813.863420:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961856 00000100:00100000:0.0:1787864813.864317:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 197 00000100:00100000:0.0:1787864813.864340:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12387:x1874711825961856:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787864813.864496:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12387:x1874711825961856:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 165us (6392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864813.864504:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 197 00000100:00100000:3.0:1787864813.869475:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.869629:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825961984 00000100:00100000:1.0:1787864813.869641:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825961984 00000100:00100000:1.0:1787864813.869720:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:1.0:1787864813.869732:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+8:12387:x1874711825961984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864813.869755:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864813.869781:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acbfc expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.869818:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.869829:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864813.869833:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864813.869840:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.869880:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.869938:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864813.869954:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844886400:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864813.870086:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275412ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864813.882661:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844886400:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864813.882719:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.882745:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949000, rc 0) 00000100:00100000:1.0:1787864813.882817:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+9:12387:x1874711825961984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 13086us (13354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864813.882829:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:3.0:1787864813.883339:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.883402:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962112 00000100:00100000:1.0:1787864813.883410:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962112 00010000:00010000:1.0:1787864813.883448:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864813.883970:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 88 00000100:00100000:1.0:1787864813.883984:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576454450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2410:x1874711825962112:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864813.884004:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864813.884032:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.884047:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.884075:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5025bc/0x2fcb8c294dc43faf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbf5 expref: 9 pid: 8426 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.884118:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864813.884123:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864813.884134:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.884144:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.884184:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864813.884200:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1874711844886528:192.168.206.36@tcp:105: 00000100:00100000:1.0:1787864813.884357:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275412ed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864813.890741:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6497:1874711844886528:192.168.206.36@tcp:105: 00010000:00010000:1.0:1787864813.890787:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864813.890862:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576454450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825962112:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 6874us (7517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864813.890875:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 88 00000100:00100000:0.0:1787864813.898470:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.898596:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962240 00000100:00100000:3.0:1787864813.898608:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962240 00002000:00100000:3.0:1787864813.898673:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9274490d2d00 x1874711825962240/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:664/0 lens 504/0 e 0 to 0 dl 1787864824 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787864813.898686:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490d2d00 with x1874711825962240 ext(0->8) 00002000:00010000:3.0:1787864813.898702:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9274490d2d00 00000100:00100000:3.0:1787864813.898759:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864813.899069:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825962240:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787864813.910605:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2409:x1874711825962240:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 Request processed in 11828us (12140us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787864813.910618:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00002000:00100000:0.0:1787864813.910630:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9274490d2d00 x1874711825962240/t4294967315(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:664/0 lens 504/448 e 0 to 0 dl 1787864824 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864813.910641:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490d2d00 with x1874711825962240 ext(0->8) 00002000:00010000:0.0:1787864813.910647:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9274490d2d00 00010000:00010000:1.0:1787864813.913000:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864813.924402:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864813.924885:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962368 00000100:00100000:3.0:1787864813.924932:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962368 00000100:00100000:3.0:1787864813.925011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 198 00000100:00100000:3.0:1787864813.925023:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12387:x1874711825962368:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787864813.930976:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787864813.930992:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787864813.931046:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787864813.931060:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92744818ccc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787864813.931065:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9274472d4a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92744818cb40 00000020:00080000:2.0:1787864813.931068:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92754320fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92757dcb4600 00010000:00010000:3.0:1787864813.931456:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931469:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931477:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931483:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbc00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.931487:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931494:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931512:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff927548d9cf00) 00010000:00010000:3.0:1787864813.931515:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.931520:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931527:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc43cde lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864813.931591:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1787864813.931595:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931605:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931611:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931617:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba000 already unused, calling callback (ffffffffc19e44f0) 00000100:00100000:0.0:1787864813.931622:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844886656:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787864813.931623:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931645:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931657:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864813.931659:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.931663:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931668:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc43ce5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931685:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931707:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931713:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931728:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.931731:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931737:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864813.931748:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864813.931761:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159c00) 00010000:00010000:3.0:1787864813.931767:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.931770:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931776:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc43d24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931794:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931799:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931815:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931820:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.931823:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931828:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931848:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864813.931851:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.931854:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931873:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc43e27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931929:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931935:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931940:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931945:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.931948:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931954:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931962:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864813.931965:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.931967:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931973:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc43e4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.931995:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932002:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932007:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932013:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bac00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.932016:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932022:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932030:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:3.0:1787864813.932032:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864813.932034:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932045:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc43e90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932056:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932063:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932069:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932080:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864813.932083:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932088:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932108:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:3.0:1787864813.932111:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787864813.932114:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.932120:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc43f93 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787864813.932222:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787864813.932279:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787864813.932408:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864813.932425:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844886784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864813.932755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+19:12387:x1874711825962368:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 Request processed in 7732us (8365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864813.932765:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 198 00000100:00100000:2.0:1787864813.936729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864813.938673:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844886656 00000100:00100000:3.0:1787864813.938684:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844886656 00000100:00100000:2.0:1787864813.939169:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844886784 00000100:00100000:2.0:1787864813.939174:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844886784 00000100:00100000:2.0:1787864813.939206:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864813.939218:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844886656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787864813.939284:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787864813.939304:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844886784:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1787864813.939349:0:14166:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787864813.939353:0:14166:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787864813 00002000:00010000:2.0:1787864813.939356:0:14166:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787864813.939371:0:14166:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787864813 -> 1787864813 00002000:00010000:2.0:1787864813.939373:0:14166:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787864813.939444:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844886656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (7703us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787864813.939451:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787864813.939507:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787864813.940234:0:8423:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1787864813.940280:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a90a6eb, atime: 0x6a90a6eb, ctime: 0x6a90a6eb, blocks: 0x8 00010000:00010000:0.0:1787864813.940299:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.940329:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787864813.940334:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787864813.940341:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.940361:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.940374:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.940381:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864813.940405:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864813.940444:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864813.940455:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.940467:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864813.940473:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.940496:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.940517:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.940528:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f356734/0x2fcb8c294dc43fbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864813.940553:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864813.940565:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864813.940568:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864813.940623:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1874711844886784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1323us (3898us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787864813.940634:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:0.0:1787864813.940726:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9274490d3840/2, rc 0, transno 4294967316 00000004:00080000:2.0:1787864813.940735:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff927448bfcf00/2, rc 0, transno 4294967308 00000100:00100000:0.0:1787864813.940735:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844886656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787864813.940751:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844886784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787864813.944807:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.945318:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962496 00000100:00100000:2.0:1787864813.945329:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962496 00000100:00100000:2.0:1787864813.945395:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:2.0:1787864813.945404:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2410:x1874711825962496:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787864813.951710:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1787864813.951722:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787864813.953636:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825962496:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 Request processed in 8222us (8828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864813.953649:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:3.0:1787864813.963662:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.964024:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962752 00000100:00100000:2.0:1787864813.964034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962752 00000100:00100000:2.0:1787864813.964090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 199 00000100:00100000:2.0:1787864813.964100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:12387:x1874711825962752:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864813.964152:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864813.964195:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbee expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.964277:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:2.0:1787864813.964282:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864813.964311:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.964336:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.964346:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864813.964461:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000730f3368 reply state 00000000a74c125e transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.964474:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864813.964482:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:2.0:1787864813.964485:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864813.964488:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864813.965464:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+20:12387:x1874711825962752:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 1360us (1804us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1787864813.965474:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 199 00000100:00100000:3.0:1787864813.972201:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864813.972279:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825962880 00000100:00100000:2.0:1787864813.972287:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825962880 00000100:00100000:2.0:1787864813.972340:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:2.0:1787864813.972349:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825962880:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787864813.972486:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787864813.972489:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787864813 -> 1787864812 00002000:00010000:2.0:1787864813.972492:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787864811 00002000:00010000:2.0:1787864813.972494:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787864813 -> 1787864812 00002000:00010000:2.0:1787864813.972496:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1787864813.972547:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825962880:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 199us (354us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787864813.972562:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:3.0:1787864813.991241:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864813.991309:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963136 00000100:00100000:1.0:1787864813.991318:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963136 00000100:00100000:1.0:1787864813.991371:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:1.0:1787864813.991381:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+20:12387:x1874711825963136:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787864813.991441:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.991465:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 20 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.991475:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.991508:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 20 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864813.991521:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 20 pid: 10168 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864813.991535:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844886912:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864813.991613:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864813.996162:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844886912:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864813.996192:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864814.003265:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.006176:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963264 00000100:00100000:1.0:1787864814.006189:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963264 00010000:00010000:1.0:1787864814.006230:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 21 pid: 10168 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.006270:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 89 00000100:00100000:1.0:1787864814.006279:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+21:2409:x1874711825963264:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864814.006293:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864814.006306:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 21 pid: 10168 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006319:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 21 pid: 10168 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006341:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc43f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe0 expref: 21 pid: 10168 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006353:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:1.0:1787864814.006359:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006369:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006375:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.006441:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864814.006495:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+20:2409:x1874711825963264:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 217us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.006503:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 89 00010000:00010000:2.0:1787864814.009066:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009081:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009118:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009126:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009133:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009140:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864814.009144:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009152:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009168:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:2.0:1787864814.009171:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787864814.009176:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.009183:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc43fcb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.009313:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+19:12387:x1874711825963136:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 Request processed in 17931us (18076us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787864814.009324:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 200 00000100:00100000:0.0:1787864814.022308:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.022382:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963392 00000100:00100000:1.0:1787864814.022390:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963392 00000100:00100000:1.0:1787864814.022445:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:1.0:1787864814.022456:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825963392:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787864814.022497:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.022528:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.022536:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787864814.022540:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864814.022544:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.022577:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.022591:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 8 pid: 8820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.022604:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844887040:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864814.022680:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864814.025533:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.025623:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8426:1874711844887040:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864814.025648:0:8426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.025715:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963520 00000100:00100000:2.0:1787864814.025721:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963520 00010000:00010000:2.0:1787864814.025754:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.025790:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 90 00000100:00100000:2.0:1787864814.025799:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825963520:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864814.025821:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864814.025842:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.025855:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.025876:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d52fdac/0x2fcb8c294dc43fb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbfc expref: 9 pid: 8820 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.025912:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864814.025917:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864814.025922:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.025947:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.025972:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864814.026013:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825963520:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 215us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864814.026020:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 90 00010000:00010000:3.0:1787864814.026263:0:8426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026273:0:8426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026292:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026312:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026321:0:8426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026327:0:8426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864814.026332:0:8426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026340:0:8426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026352:0:8426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.026360:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc43fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.026415:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fad8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825963392:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 Request processed in 3961us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.026423:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:3.0:1787864814.032623:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864814.032935:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963776 00000100:00100000:0.0:1787864814.032947:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963776 00000100:00100000:0.0:1787864814.033005:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 201 00000100:00100000:0.0:1787864814.033016:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+19:12387:x1874711825963776:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787864814.033084:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.033101:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.033111:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.033148:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.033163:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 19 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864814.033178:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887168:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864814.033251:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864814.038051:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887168:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864814.038080:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.038791:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.039010:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825963904 00000100:00100000:2.0:1787864814.039021:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825963904 00010000:00010000:2.0:1787864814.039079:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 20 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.039166:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 91 00000100:00100000:2.0:1787864814.039179:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+20:2410:x1874711825963904:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864814.039213:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864814.039221:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 20 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039240:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 20 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039265:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc43e20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb85 expref: 20 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039281:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864814.039295:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039307:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039316:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.039347:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864814.039425:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+19:2410:x1874711825963904:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 249us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864814.039433:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 91 00010000:00010000:0.0:1787864814.039533:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039549:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039732:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039750:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 19 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039758:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039792:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 19 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.039808:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 19 pid: 13804 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864814.039821:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757bcc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887296:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864814.039918:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864814.045038:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757bcc43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887296:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864814.045071:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.045456:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.045516:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825964032 00000100:00100000:1.0:1787864814.045525:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825964032 00010000:00010000:1.0:1787864814.045564:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 20 pid: 13804 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.045631:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 92 00000100:00100000:1.0:1787864814.045645:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+20:2409:x1874711825964032:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864814.045663:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864814.045670:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 20 pid: 13804 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045686:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 20 pid: 13804 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045723:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc43f9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbe7 expref: 20 pid: 13804 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045743:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:1.0:1787864814.045750:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045759:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045768:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.045848:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864814.045953:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+19:2409:x1874711825964032:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 310us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.045963:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 92 00010000:00010000:0.0:1787864814.052462:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.052478:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864814.052827:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1787864814.052995:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1787864814.053558:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1787864814.053811:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10168:1874711844887424:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787864814.053922:0:10168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864814.053967:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283480 going to sleep for 11 seconds 00000100:00100000:1.0:1787864814.054204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844887424 00000100:00100000:1.0:1787864814.054229:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844887424 00000100:00100000:1.0:1787864814.054303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787864814.054313:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10168:x1874711844887424:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787864814.054451:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10168:x1874711844887424:12345-0@lo:1000:mdt00_004.0 Request processed in 140us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.054459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787864814.054507:0:10168:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787864814.054515:0:10168:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9274490d3840, transno 4294967316 00000100:00100000:3.0:1787864814.054536:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10168:1874711844887424:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787864814.054704:0:10168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787864814.054762:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10168:1874711844887552:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787864814.054800:0:10168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864814.054834:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff927576451000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864814.054936:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844887552 00000100:00100000:0.0:1787864814.054949:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844887552 00000100:00100000:0.0:1787864814.054996:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787864814.055005:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:10168:x1874711844887552:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787864814.055141:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10168:x1874711844887552:12345-0@lo:1000:mdt00_004.0 Request processed in 137us (340us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787864814.055149:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787864814.055979:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10168:1874711844887552:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1787864814.056032:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056042:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056048:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056055:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864814.056060:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056067:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056082:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:1.0:1787864814.056086:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864814.056090:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056096:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc43fe0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056142:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056148:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056154:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056160:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864814.056163:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056169:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056177:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:1.0:1787864814.056180:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864814.056183:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056188:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43f15 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056210:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056222:0:10168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 22 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056231:0:10168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056270:0:10168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 22 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.056288:0:10168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 22 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.056303:0:10168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887680:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864814.056401:0:10168:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864814.062823:0:10168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10168:1874711844887680:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864814.062855:0:10168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.064731:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.064926:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825964160 00000100:00100000:2.0:1787864814.064935:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825964160 00010000:00010000:2.0:1787864814.064973:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 23 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.065010:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 93 00000100:00100000:2.0:1787864814.065022:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+23:2410:x1874711825964160:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864814.065035:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864814.065042:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 23 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065054:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 23 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065075:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc43f31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acbcb expref: 23 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065105:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:2.0:1787864814.065110:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065120:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065128:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.065160:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864814.065214:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2410:x1874711825964160:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 195us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864814.065222:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 93 00010000:00010000:1.0:1787864814.065355:0:10168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065363:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065374:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065380:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065387:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065393:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864814.065404:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065411:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065420:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:1.0:1787864814.065423:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864814.065426:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065431:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc43fe7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065442:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065448:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065453:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065458:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bba00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864814.065461:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065466:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065472:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927549cf1600) 00010000:00010000:1.0:1787864814.065474:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864814.065480:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.065486:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc43fd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.065615:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12387:x1874711825963776:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 32602us (33007us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787864814.065623:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 201 00000020:00080000:1.0:1787864814.065627:0:10168:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787864814.066932:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864814.066938:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787864814.067508:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787864814.067519:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864814.073198:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.073525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825964416 00000100:00100000:2.0:1787864814.073541:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825964416 00000100:00100000:2.0:1787864814.073622:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:2.0:1787864814.073634:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12387:x1874711825964416:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787864814.073982:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787864814.074025:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1787864814.076711:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076740:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076767:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076779:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076786:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076792:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.076820:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787864814.076986:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+23:12387:x1874711825964416:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 3348us (3790us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787864814.076999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00000020:00080000:2.0:1787864814.077006:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787864814.077724:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864814.077736:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.077747:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864814.077752:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.077761:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.077789:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:0.0:1787864814.077792:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787864814.077797:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.077804:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc43fee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.077817:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864814.077819:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864814.077820:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787864814.140825:0:14644:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787864814.140839:0:14644:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787864814.140936:0:14644:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787864814.140943:0:14644:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787864814.271113:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.271181:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825964672 00000100:00100000:3.0:1787864814.271191:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825964672 00000100:00100000:3.0:1787864814.271250:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:3.0:1787864814.271262:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+23:12397:x1874711825964672:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864814.271285:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864814.271305:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc03 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.271405:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43ffc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.271419:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43ffc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.271429:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43ffc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864814.271469:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1787864814.271566:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc43ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc03 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.271582:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43ffc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc03 expref: 25 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.271590:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864814.271592:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864814.271595:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f000, rc 0) 00000100:00100000:3.0:1787864814.271656:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12397:x1874711825964672:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 398us (552us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787864814.271664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 202 00000100:00100000:1.0:1787864814.279970:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.280416:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825964800 00000100:00100000:3.0:1787864814.280429:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825964800 00000100:00100000:3.0:1787864814.280504:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 203 00000100:00100000:3.0:1787864814.280515:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12397:x1874711825964800:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:3.0:1787864814.280627:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.280797:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.280814:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.280834:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.280865:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.280873:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281007:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281016:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281023:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864814.281078:0:13804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281092:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281099:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281105:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281111:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.281115:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281123:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281144:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864814.281147:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.281153:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281159:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4400a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281171:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281176:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281182:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281187:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.281189:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281195:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281432:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927566faae00) 00010000:00010000:3.0:1787864814.281434:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.281438:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281443:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44011 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281473:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281479:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281485:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281490:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ec00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.281494:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281499:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281506:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faa300) 00010000:00010000:3.0:1787864814.281587:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.281632:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.281785:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44018 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.284147:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12397:x1874711825964800:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 3615us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.284168:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 203 00000100:00100000:0.0:1787864814.357475:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.357625:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965056 00000100:00100000:3.0:1787864814.357634:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965056 00000100:00100000:3.0:1787864814.357701:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 204 00000100:00100000:3.0:1787864814.357722:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12400:x1874711825965056:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864814.357741:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864814.357760:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4401f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc0a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.357842:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.358961:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.358976:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.358995:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359003:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359010:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359119:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359127:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359134:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864814.359155:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787864814.359746:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359756:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359763:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359770:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.359774:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359782:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359794:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864814.359797:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.359802:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359808:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44026 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359821:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359827:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.359843:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360611:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.360616:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360623:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360634:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927566faa300) 00010000:00010000:3.0:1787864814.360637:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.360641:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360647:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc4402d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360712:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4401f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360726:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.360734:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864814.360736:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864814.360739:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e000, rc 0) 00000100:00100000:3.0:1787864814.360964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12400:x1874711825965056:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 3242us (3495us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787864814.360983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 204 00000100:00100000:2.0:1787864814.374670:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.374997:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965184 00000100:00100000:3.0:1787864814.375007:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965184 00000100:00100000:3.0:1787864814.375065:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 205 00000100:00100000:3.0:1787864814.375075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12400:x1874711825965184:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:3.0:1787864814.375137:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375153:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375178:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375334:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375343:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375349:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375356:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ec00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.375361:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375368:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375380:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864814.375394:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864814.375399:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.375406:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc44042 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.375468:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12400:x1874711825965184:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 394us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.375476:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 205 00000100:00100000:1.0:1787864814.378481:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864814.379018:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965440 00000100:00100000:0.0:1787864814.379032:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965440 00000100:00100000:2.0:1787864814.379259:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:2.0:1787864814.379269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12400:x1874711825965440:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864814.379490:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+28:12400:x1874711825965440:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 221us (1023us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787864814.379497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:0.0:1787864814.409371:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.409608:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965696 00000100:00100000:2.0:1787864814.409617:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965696 00000100:00100000:2.0:1787864814.409675:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 206 00000100:00100000:2.0:1787864814.409685:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+28:11933:x1874711825965696:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864814.409720:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864814.409742:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc44049 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc11 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.409845:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.409860:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 29 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.409882:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.409955:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 29 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.409968:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 29 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.409980:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844887808:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864814.410064:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff92744818c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864814.414613:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.414742:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844887808:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864814.414768:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.414915:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965824 00000100:00100000:1.0:1787864814.414922:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965824 00010000:00010000:1.0:1787864814.414954:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 30 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.414986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 94 00000100:00100000:1.0:1787864814.414994:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+30:2409:x1874711825965824:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864814.415007:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864814.415013:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 30 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415025:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 30 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415045:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44034 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc0a expref: 30 pid: 6510 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415609:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:1.0:1787864814.415614:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415622:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415628:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.415701:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864814.415761:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+29:2409:x1874711825965824:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 766us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.415770:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 94 00010000:00010000:2.0:1787864814.416639:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.416650:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864814.416669:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787864814.416802:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031200/0x2fcb8c294dc44049 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 30 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.416821:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 29 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.416828:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:2.0:1787864814.416831:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864814.416834:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864814.416910:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757bcc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+29:11933:x1874711825965696:12345-192.168.206.36@tcp:101:bash.0 Request processed in 7226us (7548us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1787864814.416918:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 206 00000100:00100000:0.0:1787864814.419645:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.425186:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825965952 00000100:00100000:1.0:1787864814.425206:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825965952 00000100:00100000:1.0:1787864814.425278:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 207 00000100:00100000:1.0:1787864814.425289:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+29:11933:x1874711825965952:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:1.0:1787864814.425312:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864814.425332:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4405e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc18 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425366:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425379:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425420:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425925:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4405e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc18 expref: 31 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425945:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc18 expref: 30 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.425954:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:1.0:1787864814.425957:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864814.425960:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949e00, rc 0) 00000100:00100000:1.0:1787864814.426033:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11933:x1874711825965952:12345-192.168.206.36@tcp:101:bash.0 Request processed in 745us (6518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.426041:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 207 00000100:00100000:1.0:1787864814.435865:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.436088:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966208 00000100:00100000:3.0:1787864814.436097:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966208 00000100:00100000:3.0:1787864814.436164:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 208 00000100:00100000:3.0:1787864814.436174:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+30:11933:x1874711825966208:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:3.0:1787864814.436397:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.436654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.436668:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864814.436726:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787864814.436750:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b169a31 reply state 00000000b6cc81e6 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.436762:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.436769:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864814.436783:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864814.436787:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787864814.436823:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787864814.437198:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+34:11933:x1874711825966208:12345-192.168.206.36@tcp:36:bash.0 Request processed in 1015us (1344us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787864814.437207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 208 00000020:00080000:3.0:1787864814.437213:0:6512:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787864814.440498:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.441151:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966336 00000100:00100000:3.0:1787864814.441170:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966336 00000100:00100000:3.0:1787864814.441685:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 209 00000100:00100000:3.0:1787864814.441706:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+34:11933:x1874711825966336:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864814.441729:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864814.441748:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44073 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc1f expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.441806:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44073 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc1f expref: 35 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.441822:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44073 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc1f expref: 35 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.441838:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864814.441840:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864814.441844:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ee00, rc 0) 00000100:00100000:3.0:1787864814.441944:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+35:11933:x1874711825966336:12345-192.168.206.36@tcp:101:bash.0 Request processed in 241us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.441952:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 209 00000100:00100000:0.0:1787864814.447858:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.448149:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966464 00000100:00100000:2.0:1787864814.448166:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966464 00000100:00100000:2.0:1787864814.448229:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:2.0:1787864814.448239:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:11933:x1874711825966464:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864814.448256:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864814.448282:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc26 expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787864814.448324:0:8820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a90a6ec, atime: 0x6a90a6eb, ctime: 0x6a90a6ec, blocks: 0x8 00010000:00010000:2.0:1787864814.448346:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1787864814.448350:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864814.448359:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.448374:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.448387:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864814.448447:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274472ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+8:11933:x1874711825966464:12345-192.168.206.36@tcp:101:bash.0 Request processed in 209us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864814.448454:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:0.0:1787864814.452189:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.452353:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966592 00000100:00100000:2.0:1787864814.452362:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966592 00002000:00010000:2.0:1787864814.452402:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787864814.452484:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff92757dbbb840 with x1874711825966592 ext(0->18446744073709551615) 00002000:00010000:2.0:1787864814.452497:0:8431:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92757dbbb840. 00000100:00100000:2.0:1787864814.452640:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:2.0:1787864814.452651:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825966592:12345-192.168.206.36@tcp:10:bash.0 00002000:00010000:2.0:1787864814.452949:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787864814.452953:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1787864812 -> 1787864814 00002000:00010000:2.0:1787864814.452956:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1787864811 -> 1787864811 00002000:00010000:2.0:1787864814.452958:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1787864812 -> 1787864814 00002000:00010000:2.0:1787864814.452970:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787864814.453023:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2410:x1874711825966592:12345-192.168.206.36@tcp:10:bash.0 Request processed in 374us (842us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787864814.453032:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00002000:00010000:2.0:1787864814.453035:0:8431:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1787864814.453038:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff92757dbbb840 with x1874711825966592 ext(0->18446744073709551615) 00002000:00010000:2.0:1787864814.453044:0:8431:0:(ofd_dev.c:2837:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92757dbbb840. 00000100:00100000:0.0:1787864814.545793:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.545964:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966720 00000100:00100000:3.0:1787864814.545992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966720 00000100:00100000:3.0:1787864814.546075:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 210 00000100:00100000:3.0:1787864814.546088:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+35:12414:x1874711825966720:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:3.0:1787864814.546183:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546203:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546217:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546234:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546241:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546248:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546401:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546411:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546419:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864814.546474:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546498:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546506:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546513:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546519:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.546524:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546533:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546548:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864814.546551:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.546558:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546565:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f400/0x2fcb8c294dc44081 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546581:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546588:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546593:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546604:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.546607:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546612:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546627:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927566faa300) 00010000:00010000:3.0:1787864814.546630:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.546632:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546639:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546658:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546663:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546668:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546673:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864814.546676:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546681:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546711:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864814.546714:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864814.546717:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.546723:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc4408f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.547957:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274482d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+35:12414:x1874711825966720:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 1858us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.547971:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 210 00000100:00100000:0.0:1787864814.596515:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.597252:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825966976 00000100:00100000:2.0:1787864814.597268:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825966976 00000100:00100000:2.0:1787864814.597354:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 211 00000100:00100000:2.0:1787864814.597367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+35:12417:x1874711825966976:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864814.597394:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864814.597421:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44096 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc2d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597511:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597555:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597573:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597580:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597609:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597771:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc440ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597782:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc440ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597790:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc440ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864814.597802:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787864814.597956:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597965:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597972:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597978:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864814.597983:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.597992:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598006:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864814.598009:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864814.598022:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598029:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc4409d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598047:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598053:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598059:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598064:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864814.598068:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598073:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598082:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:2.0:1787864814.598084:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864814.598087:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598092:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598143:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44096 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc2d expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598170:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc440ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc2d expref: 37 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.598177:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:2.0:1787864814.598179:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864814.598181:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031600, rc 0) 00000100:00100000:2.0:1787864814.598275:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12417:x1874711825966976:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 910us (1766us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787864814.598284:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 211 00000100:00100000:0.0:1787864814.604343:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.609105:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825967104 00000100:00100000:3.0:1787864814.609123:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825967104 00000100:00100000:3.0:1787864814.609230:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 212 00000100:00100000:3.0:1787864814.609242:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12417:x1874711825967104:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:3.0:1787864814.609335:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.609357:0:13804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 37 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.609368:0:13804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.609410:0:13804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 37 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.609427:0:13804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 37 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.609463:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844887936:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864814.609607:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff927576451e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864814.613492:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13804:1874711844887936:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864814.613523:0:13804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864814.613721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.613862:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825967360 00000100:00100000:1.0:1787864814.613877:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825967360 00000100:00100000:1.0:1787864814.614210:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:1.0:1787864814.614221:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:10793:x1874711825967360:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787864814.614619:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+39:10793:x1874711825967360:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 389us (888us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787864814.614628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:0.0:1787864814.624539:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.624817:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825967488 00000100:00100000:2.0:1787864814.624830:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825967488 00010000:00010000:2.0:1787864814.625161:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 39 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864814.625406:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 95 00000100:00100000:2.0:1787864814.625421:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+39:2407:x1874711825967488:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864814.625441:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864814.625450:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 39 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.625466:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 39 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.625493:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44050 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc11 expref: 39 pid: 8448 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.625539:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:2.0:1787864814.625545:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.625556:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.625565:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.629190:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864814.629265:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:2407:x1874711825967488:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 3843us (4734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864814.629278:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 95 00010000:00010000:0.0:1787864814.631804:0:13804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631827:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631932:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631942:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631951:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631959:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864814.631964:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.631974:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.632013:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:0.0:1787864814.632017:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864814.632023:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.632032:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc440b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864814.632152:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12417:x1874711825967104:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 22906us (27818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864814.632165:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 212 00000100:00100000:1.0:1787864814.638836:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.640207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825967744 00000100:00100000:3.0:1787864814.640219:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825967744 00000100:00100000:1.0:1787864814.640397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:1.0:1787864814.640407:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+37:12417:x1874711825967744:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:1.0:1787864814.642424:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+38:12417:x1874711825967744:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 2008us (3587us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787864814.642436:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:2.0:1787864814.729712:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.730584:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825968000 00000100:00100000:1.0:1787864814.730593:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825968000 00000100:00100000:1.0:1787864814.730654:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 213 00000100:00100000:1.0:1787864814.730665:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+38:12428:x1874711825968000:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:1.0:1787864814.730696:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864814.730716:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc440c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc34 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730781:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730795:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730806:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730820:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730828:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.730834:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739717:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc440d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739741:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc440d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739752:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc440d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864814.739765:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787864814.739842:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739849:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739854:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739860:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864814.739876:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.739882:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741086:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864814.741090:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864814.741096:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741103:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc440c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741118:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741124:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741129:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741134:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864814.741137:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741144:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741151:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927447234b00) 00010000:00010000:0.0:1787864814.741153:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864814.741168:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741173:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc440ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741224:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc440c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc34 expref: 41 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741238:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc440d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc34 expref: 40 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.741245:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:0.0:1787864814.741247:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864814.741250:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:0.0:1787864814.741375:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12428:x1874711825968000:12345-192.168.206.36@tcp:101:cat.0 Request processed in 10711us (11669us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787864814.741385:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 213 00000100:00100000:0.0:1787864814.755563:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.755794:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825968256 00000100:00100000:2.0:1787864814.755806:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825968256 00000100:00100000:2.0:1787864814.756008:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:2.0:1787864814.756020:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+40:12428:x1874711825968256:12345-192.168.206.36@tcp:35:cat.0 00000100:00100000:2.0:1787864814.756398:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+41:12428:x1874711825968256:12345-192.168.206.36@tcp:35:cat.0 Request processed in 379us (850us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787864814.756408:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:1.0:1787864814.774994:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864814.775132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825968512 00000100:00100000:2.0:1787864814.775144:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825968512 00000100:00100000:2.0:1787864814.775226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 214 00000100:00100000:2.0:1787864814.775237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+41:12429:x1874711825968512:12345-192.168.206.36@tcp:36:rm.0 00010000:00010000:2.0:1787864814.775336:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1787864814.775372:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44073 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc1f expref: 41 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775399:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc440d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc34 expref: 40 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775413:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc440ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc2d expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775428:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc18 expref: 38 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775440:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:2.0:1787864814.775446:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864814.775473:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775489:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775499:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775515:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775522:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775540:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775635:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775644:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.775651:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864814.775972:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:2.0:1787864814.776028:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776037:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776046:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776054:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776062:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776069:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776099:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864814.776130:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776137:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776143:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776149:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864814.776154:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776163:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776173:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:2.0:1787864814.776176:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787864814.776180:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776187:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc440f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776203:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776209:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776215:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776220:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864814.776229:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776234:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776243:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864814.776246:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864814.776248:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776254:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc440e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864814.776265:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174a8b38 reply state 000000006d32f386 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776277:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864814.776284:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:2.0:1787864814.776286:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864814.776288:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864814.776381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+39:12429:x1874711825968512:12345-192.168.206.36@tcp:36:rm.0 Request processed in 1144us (1403us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787864814.776390:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 214 00010000:00010000:0.0:1787864814.776756:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864814.776764:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.776771:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864814.776774:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.776781:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.776791:0:10329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:0.0:1787864814.776801:0:10329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787864814.776805:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.776811:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc440f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.776823:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864814.776825:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864814.776826:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864814.828709:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.828809:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825968768 00000100:00100000:1.0:1787864814.828819:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825968768 00000100:00100000:0.0:1787864814.828983:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 215 00000100:00100000:0.0:1787864814.828995:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+39:12435:x1874711825968768:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:0.0:1787864814.829024:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864814.829047:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc440ff lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc3b expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829168:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829195:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829208:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829219:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829227:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829260:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864814.829655:0:13804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787864814.829808:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829818:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829826:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829860:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829867:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829874:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829880:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864814.829886:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829925:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829938:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864814.829942:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864814.829955:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829962:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44106 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864814.829976:0:13804:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c679506 reply state 0000000003ef3425 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829987:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.829994:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:0.0:1787864814.829997:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864814.829999:0:13804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787864814.830030:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc440ff lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 42 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.830044:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 41 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864814.830051:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:0.0:1787864814.830054:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864814.830056:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbe00, rc 0) 00000100:00100000:0.0:1787864814.830144:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+42:12435:x1874711825968768:12345-192.168.206.36@tcp:101:bash.0 Request processed in 1150us (1456us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787864814.830152:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 215 00000100:00100000:2.0:1787864814.835710:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.835797:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825968896 00000100:00100000:3.0:1787864814.835808:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825968896 00000100:00100000:3.0:1787864814.835882:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:3.0:1787864814.835938:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825968896:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864814.835959:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864814.835981:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc42 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787864814.836010:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787864814.836032:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1787864814.836037:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864814.836048:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.836067:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 8 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.836105:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e600, rc 0) 00000100:00100000:3.0:1787864814.836166:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825968896:12345-192.168.206.36@tcp:101:bash.0 Request processed in 232us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.836174:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:2.0:1787864814.842966:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864814.843111:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825969024 00000100:00100000:3.0:1787864814.843123:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825969024 00000100:00100000:3.0:1787864814.843195:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:3.0:1787864814.843207:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:12435:x1874711825969024:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864814.843236:0:8426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864814.843269:0:8426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc49 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.843314:0:8426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.843325:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864814.843330:0:8426:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864814.843337:0:8426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.843382:0:8426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 9 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.843397:0:8426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 9 pid: 8423 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.843434:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874711844888064:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864814.843562:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff927576451e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864814.847005:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.847109:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825969152 00000100:00100000:1.0:1787864814.847120:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825969152 00010000:00010000:1.0:1787864814.847167:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 10 pid: 8423 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.847219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 96 00000100:00100000:1.0:1787864814.847230:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2409:x1874711825969152:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864814.847259:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864814.847287:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 10 pid: 8423 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.847303:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 10 pid: 8423 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.847333:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864814.847338:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864814.847349:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.847362:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864814.847404:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 10 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864814.847436:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490ca580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1874711844888192:192.168.206.36@tcp:105: 00000100:00100000:1.0:1787864814.847539:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787864814.848530:0:8426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44122 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc42 expref: 10 pid: 8423 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864814.848553:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8426:1874711844888064:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864814.848586:0:8426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 9 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864814.848599:0:8426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f400, rc 0) 00000100:00100000:3.0:1787864814.848662:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+9:12435:x1874711825969024:12345-192.168.206.36@tcp:101:bash.0 Request processed in 5457us (5710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864814.848672:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:1.0:1787864814.852506:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490ca580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6498:1874711844888192:192.168.206.36@tcp:105: 00010000:00010000:1.0:1787864814.852544:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864814.852616:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825969152:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 5387us (5637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864814.852630:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 96 00000100:00100000:0.0:1787864814.854076:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864814.854171:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825969408 00000100:00100000:1.0:1787864814.854182:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825969408 00000100:00100000:2.0:1787864814.854355:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:2.0:1787864814.854370:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+42:12435:x1874711825969408:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:2.0:1787864814.854757:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12435:x1874711825969408:12345-192.168.206.36@tcp:35:bash.0 Request processed in 390us (689us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787864814.854765:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00010000:00010000:1.0:1787864814.937106:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864815.008055:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.008214:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825969536 00000100:00100000:3.0:1787864815.008225:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825969536 00000100:00100000:3.0:1787864815.008310:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 216 00000100:00100000:3.0:1787864815.008322:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+43:12451:x1874711825969536:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864815.008352:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864815.008377:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc50 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008454:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008483:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008499:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864815.008550:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787864815.008554:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864815.008576:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008603:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e600/0x2fcb8c294dc44130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc50 expref: 45 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008625:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc50 expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.008634:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864815.008638:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864815.008641:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e200, rc 0) 00000100:00100000:3.0:1787864815.008730:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+44:12451:x1874711825969536:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 411us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.008738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 216 00000100:00080000:2.0:1787864815.008820:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864815.016045:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.016162:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825969792 00000100:00100000:2.0:1787864815.016173:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825969792 00000100:00100000:2.0:1787864815.016259:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 217 00000100:00100000:2.0:1787864815.016270:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449028f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+44:12451:x1874711825969792:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864815.016296:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.016322:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4413e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc57 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.016457:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc44145 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.016474:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc44145 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.016488:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc44145 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864815.016501:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787864815.016631:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc4413e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc57 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.016653:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc44145 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc57 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.016662:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:2.0:1787864815.016681:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864815.016697:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796a00, rc 0) 00000100:00100000:2.0:1787864815.016771:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449028f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+46:12451:x1874711825969792:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 502us (738us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1787864815.016779:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 217 00000100:00100000:1.0:1787864815.022093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.022144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864815.022241:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970048 00000100:00100000:0.0:1787864815.022253:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970048 00000100:00100000:0.0:1787864815.022326:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 218 00000100:00100000:0.0:1787864815.022338:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+46:12451:x1874711825970048:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864815.022367:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864815.022393:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc44153 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc5e expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.022521:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.022539:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.022553:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864815.022567:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787864815.022715:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba000/0x2fcb8c294dc44153 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc5e expref: 49 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.022740:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc5e expref: 48 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.022751:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:0.0:1787864815.022755:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787864815.022759:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbc00, rc 0) 00000100:00100000:0.0:1787864815.022837:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+48:12451:x1874711825970048:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 501us (757us total) trans 4294967487 rc 0/0 00000100:00100000:0.0:1787864815.022871:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 218 00000100:00100000:3.0:1787864815.022973:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970176 00000100:00100000:3.0:1787864815.022987:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970176 00000100:00100000:3.0:1787864815.023075:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:3.0:1787864815.023090:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+48:2407:x1874711825970176:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864815.023106:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864815.023156:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc44145 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc57 expref: 48 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.023175:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:3.0:1787864815.023181:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864815.023304:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+47:2407:x1874711825970176:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 219us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.023313:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:1.0:1787864815.031615:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.031748:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970304 00000100:00100000:3.0:1787864815.031760:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970304 00000100:00100000:3.0:1787864815.031859:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:3.0:1787864815.031872:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825970304:12345-192.168.206.36@tcp:1:lfs.0 00010000:00010000:3.0:1787864815.031963:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787864815.031964:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787864815.031991:0:8425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.032002:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787864815.032007:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864815.032012:0:8425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.032057:0:8425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 8 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.032073:0:8425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 8 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864815.032106:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1874711844888320:192.168.206.36@tcp:104: 00000100:00100000:3.0:1787864815.032449:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff927576451e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787864815.035447:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.035572:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8425:1874711844888320:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864815.035607:0:8425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864815.035701:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970432 00000100:00100000:0.0:1787864815.035710:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970432 00002000:00100000:0.0:1787864815.035767:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9274490f3840 x1874711825970432/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:666/0 lens 504/0 e 0 to 0 dl 1787864826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864815.035778:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490f3840 with x1874711825970432 ext(0->8) 00010000:00010000:0.0:1787864815.035786:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 9 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.035802:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 9 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864815.035810:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9274490f3840 00000100:00100000:0.0:1787864815.035850:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:0.0:1787864815.035868:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825970432:12345-192.168.206.36@tcp:4:lfs.0 00000100:00100000:0.0:1787864815.037065:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2409:x1874711825970432:12345-192.168.206.36@tcp:4:lfs.0 Request processed in 1190us (1622us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787864815.037078:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00002000:00100000:0.0:1787864815.037089:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9274490f3840 x1874711825970432/t4294967309(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:666/0 lens 504/448 e 0 to 0 dl 1787864826 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864815.037100:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490f3840 with x1874711825970432 ext(0->8) 00010000:00010000:0.0:1787864815.037108:0:8430:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.037143:0:8430:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787864815.037152:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9274490f3840 00000100:00100000:2.0:1787864815.039587:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.039766:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970560 00000100:00100000:1.0:1787864815.039776:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970560 00010000:00010000:1.0:1787864815.039826:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.039877:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 97 00000100:00100000:1.0:1787864815.039930:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2408:x1874711825970560:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864815.039950:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787864815.039972:0:6498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787864815.039975:0:6498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787864814 00002000:00010000:1.0:1787864815.039978:0:6498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787864814 00002000:00010000:1.0:1787864815.039980:0:6498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787864814 00002000:00010000:1.0:1787864815.039999:0:6498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1787864815.040007:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.040024:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.040055:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c5a3f5/0x2fcb8c294dc44129 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc49 expref: 11 pid: 8426 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.040075:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864815.040079:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787864815.040087:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.040099:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.040140:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864815.040208:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2408:x1874711825970560:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 321us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.040217:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 97 00010000:00010000:2.0:1787864815.040286:0:8425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040297:0:8425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040321:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040330:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040338:0:8425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040346:0:8425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864815.040351:0:8425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040375:0:8425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040387:0:8425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.040396:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad045bf/0x2fcb8c294dc44168 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.040448:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825970304:12345-192.168.206.36@tcp:1:lfs.0 Request processed in 8580us (8846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.040457:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:1.0:1787864815.043422:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.043496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970816 00000100:00100000:2.0:1787864815.043508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970816 00000100:00100000:2.0:1787864815.043575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:2.0:1787864815.043585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+47:12451:x1874711825970816:12345-192.168.206.36@tcp:35:lfs.0 00000004:00010000:2.0:1787864815.043664:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc5e expref: 47 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864815.043924:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1787864815.043962:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787864815.044312:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1787864815.044354:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.044371:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 51 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.044397:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.044437:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 51 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.044453:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 51 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.044471:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1874711844888448:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864815.044658:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275412ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864815.050592:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.050678:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825970944 00000100:00100000:1.0:1787864815.050699:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825970944 00010000:00010000:1.0:1787864815.050749:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 52 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.050821:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 98 00000100:00100000:1.0:1787864815.050831:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449028780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+52:2410:x1874711825970944:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864815.050857:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864815.050865:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 52 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.050880:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 52 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.050938:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:1.0:1787864815.050945:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.050956:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.050964:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.050986:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864815.051048:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449028780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+52:2410:x1874711825970944:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 217us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.051057:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 98 00010000:00010000:2.0:1787864815.054428:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44114 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc3b expref: 51 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.054462:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6513:1874711844888448:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864815.054495:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.054506:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.054513:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864815.054653:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1787864815.054802:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787864815.055118:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844888576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864815.055234:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.055280:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864815.055573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844888576 00000100:00100000:3.0:1787864815.055582:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844888576 00000100:00100000:3.0:1787864815.055665:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787864815.055676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844888576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787864815.055808:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844888576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.055817:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787864815.056004:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864815.056042:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844888576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787864815.056359:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1787864815.056436:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844888704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787864815.056478:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.056558:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864815.056790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844888704 00000100:00100000:3.0:1787864815.056796:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844888704 00000100:00100000:1.0:1787864815.057110:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787864815.057121:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6513:x1874711844888704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787864815.057305:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6513:x1874711844888704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 186us (826us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787864815.057326:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787864815.057394:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f21c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6513:1874711844888704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787864815.057448:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787864815.057487:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057499:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057506:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057512:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864815.057516:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057524:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057543:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:2.0:1787864815.057547:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787864815.057552:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.057566:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4416f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787864815.057678:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787864815.057769:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787864815.057781:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340119891739ns, next at 341119889231ns, rc = 0 00000001:00080000:2.0:1787864815.057788:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1787864815.057809:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927548d9ca00) 00010000:00010000:2.0:1787864815.057812:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787864815.057820:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4415a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc5e expref: 55 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.057970:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:12451:x1874711825970816:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 14386us (14560us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787864815.057979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 56 00000020:00080000:2.0:1787864815.057983:0:6513:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787864815.061323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.061426:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825971072 00000100:00100000:3.0:1787864815.061438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825971072 00000100:00100000:3.0:1787864815.061540:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 219 00000100:00100000:3.0:1787864815.061552:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+54:12451:x1874711825971072:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864815.061582:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864815.061611:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44176 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc65 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.061682:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44176 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc65 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.061728:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44176 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc65 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.061750:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864815.061754:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864815.061759:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ee00, rc 0) 00000100:00100000:3.0:1787864815.061829:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+55:12451:x1874711825971072:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 279us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.061837:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 219 00000100:00100000:0.0:1787864815.064770:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.065050:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825971328 00000100:00100000:2.0:1787864815.065061:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825971328 00000100:00100000:2.0:1787864815.065165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:2.0:1787864815.065177:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+55:12451:x1874711825971328:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864815.065486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+56:12451:x1874711825971328:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 310us (729us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787864815.065495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00000040:00080000:0.0:1787864815.129748:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787864815.130470:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864815.130478:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864815.130580:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787864815.130586:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864815.146204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.146943:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825971456 00000100:00100000:2.0:1787864815.146958:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825971456 00000100:00100000:2.0:1787864815.147041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 220 00000100:00100000:2.0:1787864815.147054:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+56:12461:x1874711825971456:12345-192.168.206.36@tcp:34:lfs.0 00010000:00010000:2.0:1787864815.147177:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147199:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147326:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147340:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147349:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147356:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147454:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147462:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147469:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864815.147526:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147542:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147558:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147565:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147572:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864815.147577:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147584:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147598:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864815.147601:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864815.147607:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147614:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc4417d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147629:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147786:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147793:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147799:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864815.147808:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147815:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147824:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:2.0:1787864815.147828:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864815.147831:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147838:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc44184 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147849:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147855:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147861:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147866:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796a00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864815.147869:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147874:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.147880:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.147882:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864815.148003:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.148009:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4418b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.148112:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+56:12461:x1874711825971456:12345-192.168.206.36@tcp:34:lfs.0 Request processed in 1059us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.148122:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 220 00000100:00100000:3.0:1787864815.183534:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864815.183618:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825971712 00000100:00100000:0.0:1787864815.183630:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825971712 00000100:00100000:0.0:1787864815.183759:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 221 00000100:00100000:0.0:1787864815.183771:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+56:12464:x1874711825971712:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864815.183795:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864815.183819:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc44192 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc6c expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184106:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184125:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184139:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184152:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184181:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184189:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184324:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184334:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184341:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864815.184353:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787864815.184450:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184458:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184465:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184471:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbc00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864815.184476:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184484:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184509:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:0.0:1787864815.184512:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864815.184518:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184524:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc44199 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184539:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184546:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184552:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184557:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbe00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864815.184560:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184566:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184573:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:0.0:1787864815.184575:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864815.184578:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184584:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc441a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184638:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba600/0x2fcb8c294dc44192 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 59 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184653:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 58 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.184661:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864815.184663:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864815.184666:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864815.184761:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12464:x1874711825971712:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 992us (1238us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787864815.184771:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 221 00000100:00100000:0.0:1787864815.190496:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.190829:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825971840 00000100:00100000:1.0:1787864815.190841:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825971840 00000100:00100000:3.0:1787864815.193227:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 222 00000100:00100000:3.0:1787864815.193248:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449028b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12464:x1874711825971840:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:3.0:1787864815.193361:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193382:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193395:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193457:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193491:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193499:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193506:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864815.193511:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193519:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193533:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864815.193537:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864815.193541:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.193548:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864815.193664:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449028b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12464:x1874711825971840:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 422us (3180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.193673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 222 00000100:00100000:3.0:1787864815.197602:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864815.197717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972096 00000100:00100000:0.0:1787864815.197728:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972096 00000100:00100000:0.0:1787864815.197797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:0.0:1787864815.197808:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+58:12464:x1874711825972096:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:0.0:1787864815.198149:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12464:x1874711825972096:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 342us (560us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1787864815.198158:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:0.0:1787864815.272275:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.272442:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972352 00000100:00100000:3.0:1787864815.272455:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972352 00000100:00100000:2.0:1787864815.272588:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 223 00000100:00100000:2.0:1787864815.272603:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12474:x1874711825972352:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864815.272635:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.272639:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787864815.272672:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e200/0x2fcb8c294dc44137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc50 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.272707:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864815.272713:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864815.272730:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc73 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.272878:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.273006:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 59 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.273017:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.273068:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 59 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.273083:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 59 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.273099:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844888832:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864815.273268:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927558b9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864815.276353:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844888832:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864815.276394:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864815.277409:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.277624:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972480 00000100:00100000:3.0:1787864815.277634:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972480 00010000:00010000:3.0:1787864815.277680:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 60 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.277773:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 99 00000100:00100000:1.0:1787864815.277786:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+60:2409:x1874711825972480:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864815.277807:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864815.277815:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 60 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.277830:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 60 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.278034:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc441a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc6c expref: 60 pid: 13804 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.278055:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864815.278061:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.278072:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.278081:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.278145:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864815.278364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:2409:x1874711825972480:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 580us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.278381:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 99 00010000:00010000:2.0:1787864815.278428:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.278436:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864815.278459:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787864815.278620:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.278638:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.278646:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.278649:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864815.278659:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797e00, rc 0) 00000100:00100000:2.0:1787864815.279427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12474:x1874711825972352:12345-192.168.206.36@tcp:101:bash.0 Request processed in 6238us (6575us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787864815.279440:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 223 00000100:00100000:0.0:1787864815.282149:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.282380:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972608 00000100:00100000:1.0:1787864815.282392:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972608 00000100:00100000:1.0:1787864815.282476:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 224 00000100:00100000:1.0:1787864815.282487:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449029680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+59:12474:x1874711825972608:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:1.0:1787864815.282516:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864815.282543:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc441d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc7a expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282585:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282602:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282614:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282772:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc441d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 61 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282793:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 60 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.282803:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864815.282806:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864815.282809:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948400, rc 0) 00000100:00100000:1.0:1787864815.282884:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449029680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+60:12474:x1874711825972608:12345-192.168.206.36@tcp:101:bash.0 Request processed in 399us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.282957:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 224 00000100:00100000:1.0:1787864815.289037:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.289795:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972864 00000100:00100000:3.0:1787864815.289810:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972864 00000100:00100000:3.0:1787864815.290488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 225 00000100:00100000:3.0:1787864815.290505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+60:12474:x1874711825972864:12345-192.168.206.36@tcp:36:bash.0 00010000:00010000:3.0:1787864815.290804:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.290824:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.290837:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864815.290907:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1787864815.290944:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000688f8ce4 reply state 00000000802ba40e transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.290959:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864815.290966:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864815.290969:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864815.290973:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864815.291091:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12474:x1874711825972864:12345-192.168.206.36@tcp:36:bash.0 Request processed in 590us (2258us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787864815.291108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 225 00000020:00080000:3.0:1787864815.291114:0:6510:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787864815.293467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.293581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825972992 00000100:00100000:2.0:1787864815.293593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825972992 00000100:00100000:2.0:1787864815.293757:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 226 00000100:00100000:2.0:1787864815.293768:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12474:x1874711825972992:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864815.293796:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.293824:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc81 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.294026:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.294042:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.294051:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.294096:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.294109:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 64 pid: 6511 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.294125:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844888960:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864815.294246:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff927558b9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864815.297083:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844888960:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864815.297120:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864815.299075:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864815.299485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825973120 00000100:00100000:0.0:1787864815.299497:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825973120 00010000:00010000:0.0:1787864815.299554:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 65 pid: 6511 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864815.299614:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 100 00000100:00100000:0.0:1787864815.299626:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+65:2410:x1874711825973120:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864815.299651:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864815.299659:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 65 pid: 6511 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299675:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 65 pid: 6511 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299711:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc73 expref: 65 pid: 6511 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299732:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864815.299738:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299750:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299758:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.299797:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864815.299855:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.299865:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864815.299969:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787864815.299974:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864815.300008:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.300044:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 65 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.300061:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 64 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.300069:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.300072:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864815.300075:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797a00, rc 0) 00000100:00100000:0.0:1787864815.300127:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+64:2410:x1874711825973120:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 501us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864815.300136:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 100 00000100:00100000:2.0:1787864815.300167:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12474:x1874711825972992:12345-192.168.206.36@tcp:101:bash.0 Request processed in 6401us (6714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.300175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 226 00000100:00100000:0.0:1787864815.303743:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.303936:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825973376 00000100:00100000:2.0:1787864815.303953:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825973376 00000100:00100000:2.0:1787864815.304011:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:2.0:1787864815.304022:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+63:12474:x1874711825973376:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:2.0:1787864815.304534:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12474:x1874711825973376:12345-192.168.206.36@tcp:35:bash.0 Request processed in 509us (798us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1787864815.304546:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:1.0:1787864815.342432:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.342727:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825973504 00000100:00100000:2.0:1787864815.342740:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825973504 00000100:00100000:2.0:1787864815.342921:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 227 00000100:00100000:2.0:1787864815.342936:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+64:12480:x1874711825973504:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864815.342967:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.342992:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc88 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343080:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343097:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343111:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864815.343182:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787864815.343187:0:8448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864815.343210:0:8448:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343239:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc441f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc88 expref: 66 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343288:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc88 expref: 65 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.343298:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864815.343302:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864815.343306:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797e00, rc 0) 00000100:00100000:2.0:1787864815.343385:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825973504:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 453us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.343393:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 227 00000100:00100000:3.0:1787864815.347254:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864815.347435:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825973632 00000100:00100000:1.0:1787864815.347448:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825973632 00000100:00100000:1.0:1787864815.347753:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 228 00000100:00100000:1.0:1787864815.347766:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825973632:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864815.347793:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864815.347819:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc44202 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc8f expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.347958:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.347975:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.347987:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348000:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348008:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348015:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348107:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348152:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348160:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864815.348212:0:10168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787864815.348218:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864815.348241:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348256:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348432:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348441:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348448:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348455:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864815.348459:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348467:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348484:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:1.0:1787864815.348493:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864815.348500:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348507:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44209 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348541:0:10168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348547:0:10168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348553:0:10168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348558:0:10168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864815.348562:0:10168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348568:0:10168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348588:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:1.0:1787864815.348591:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864815.348594:0:10168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348607:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44210 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348639:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc44202 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348667:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 66 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.348676:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864815.348678:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787864815.348681:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949c00, rc 0) 00000100:00100000:1.0:1787864815.348767:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12480:x1874711825973632:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1004us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.348776:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 228 00000100:00100000:0.0:1787864815.354805:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.355107:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825973888 00000100:00100000:2.0:1787864815.355119:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825973888 00000100:00100000:2.0:1787864815.355392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 229 00000100:00100000:2.0:1787864815.355404:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12480:x1874711825973888:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864815.355430:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.355456:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4421e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864815.356147:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00010000:00010000:2.0:1787864815.356407:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356429:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356437:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356472:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356518:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356535:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.356551:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844889088:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864815.356712:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.356722:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.356731:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844889216:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864815.356757:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864815.357070:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974016 00000100:00100000:1.0:1787864815.357079:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974016 00010000:00010000:1.0:1787864815.357113:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 68 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.357147:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 101 00000100:00100000:1.0:1787864815.357157:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+68:2410:x1874711825974016:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864815.357170:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864815.357177:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 68 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.357201:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 68 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.357223:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864815.357228:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.357244:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.357251:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864815.357291:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+68:2410:x1874711825974016:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 135us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.357300:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 101 00000100:00100000:0.0:1787864815.362387:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00010000:00010000:2.0:1787864815.362541:0:6511:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.36@tcp) returned -22 from blocking AST (req@00000000d7731906 x1874711844889088) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.362567:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc8f expref: 67 pid: 10168 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864815.362736:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844889088:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864815.362775:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6511:1874711844889216:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864815.362803:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.362809:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.362819:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.362830:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.366098:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974144 00000100:00100000:1.0:1787864815.366116:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974144 00010000:00010000:1.0:1787864815.366455:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864815.366548:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 102 00000100:00100000:1.0:1787864815.366560:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+67:2409:x1874711825974144:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864815.366588:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864815.366601:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366617:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366644:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797a00/0x2fcb8c294dc441ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc81 expref: 67 pid: 6512 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366663:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864815.366668:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366704:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366713:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864815.366782:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864815.366866:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+66:2409:x1874711825974144:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 308us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.366874:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 102 00010000:00010000:2.0:1787864815.368276:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.368294:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864815.368320:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787864815.368577:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796a00/0x2fcb8c294dc4421e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.368603:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.368674:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.368677:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787864815.368681:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030600, rc 0) 00000100:00100000:2.0:1787864815.368835:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12480:x1874711825973888:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 13430us (14041us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787864815.368863:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 229 00000100:00100000:0.0:1787864815.371832:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.372150:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974400 00000100:00100000:2.0:1787864815.372162:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974400 00000100:00100000:2.0:1787864815.372277:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:2.0:1787864815.372289:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12480:x1874711825974400:12345-192.168.206.36@tcp:103:lfs.0 00010000:00010000:2.0:1787864815.372312:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864815.372342:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ee00/0x2fcb8c294dc44176 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc65 expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.372362:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.372368:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864815.372444:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825974400:12345-192.168.206.36@tcp:103:lfs.0 Request processed in 156us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.372453:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:0.0:1787864815.381397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864815.383712:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974528 00000100:00100000:3.0:1787864815.383731:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974528 00000100:00100000:3.0:1787864815.383829:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 230 00000100:00100000:3.0:1787864815.383839:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825974528:12345-192.168.206.36@tcp:58:lfs.0 00010000:00010000:0.0:1787864815.384145:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.384169:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864815.384182:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864815.384306:0:13804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1787864815.384430:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825974528:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 590us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864815.384440:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 230 00000100:00100000:3.0:1787864815.387799:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864815.398987:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974656 00000100:00100000:2.0:1787864815.399007:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974656 00000100:00100000:2.0:1787864815.399323:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 231 00000100:00100000:2.0:1787864815.399337:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+65:12480:x1874711825974656:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864815.399363:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864815.399391:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acc9d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399468:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399480:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399525:0:6510:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399541:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399557:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864815.399560:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864815.399564:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 66 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864815.399573:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:2.0:1787864815.399666:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12480:x1874711825974656:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 333us (11886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864815.399675:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 231 00000100:00100000:3.0:1787864815.897421:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864815.897453:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927449029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844889344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864815.897545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898348:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889344 00000100:00100000:0.0:1787864815.898358:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889344 00000100:00100000:0.0:1787864815.898427:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787864815.898438:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844889344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864815.898475:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787864815.898535:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844889344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864815.898543:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787864815.898572:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844889728:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898637:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844890240:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898716:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844890752:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898762:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787864815.898768:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844889600:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898804:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448af61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844890112:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898867:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844890624:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.898916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864815.898943:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889728 00000100:00100000:0.0:1787864815.898948:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889728 00000100:00100000:0.0:1787864815.898976:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787864815.898982:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844889728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.899037:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844889728:12345-0@lo:400:kworker.0 Request processed in 55us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864815.899044:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787864815.899085:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844889728:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.899112:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890240 00000100:00100000:0.0:1787864815.899115:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890240 00000100:00100000:0.0:1787864815.899149:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889600 00000100:00100000:0.0:1787864815.899152:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889600 00000100:00100000:0.0:1787864815.899168:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890112 00000100:00100000:0.0:1787864815.899170:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890112 00000100:00100000:1.0:1787864815.900187:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890624 00000100:00100000:1.0:1787864815.900198:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890624 00000100:00100000:1.0:1787864815.900241:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787864815.900251:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449028780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844890240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.900531:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844889856:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.900595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.900631:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844890368:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.900669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.900706:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787864815.900713:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844889472:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.900742:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.900764:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844889984:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.900790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.900810:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844890496:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.901049:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889856 00000100:00100000:0.0:1787864815.901055:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889856 00000100:00100000:0.0:1787864815.901080:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787864815.901096:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927449029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844889600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864815.901467:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889472 00000100:00100000:3.0:1787864815.901473:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889472 00000100:00100000:3.0:1787864815.901508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1787864815.901516:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.901596:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449028780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844890240:12345-0@lo:400:kworker.0 Request processed in 1345us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.901604:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787864815.901627:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787864815.901634:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844890624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.901666:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844890624:12345-0@lo:400:kworker.0 Request processed in 34us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.901672:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787864815.901700:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787864815.901707:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844890112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.901737:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844890112:12345-0@lo:400:kworker.0 Request processed in 32us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.901755:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787864815.901768:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787864815.901774:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844889856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.901820:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844889856:12345-0@lo:400:kworker.0 Request processed in 47us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.901827:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1787864815.902032:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844890112:0@lo:400:kworker.0 00010000:00080000:1.0:1787864815.902049:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fb6b480 x1874711844890624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864815.902061:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844890624:0@lo:400:kworker.0 00010000:00080000:1.0:1787864815.902073:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448af5a40 x1874711844890240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864815.902081:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448af5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844890240:0@lo:400:kworker.0 00000004:00080000:1.0:1787864815.902191:0:9930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340964300931ns, next at 341964298090ns, rc = 0 00000100:00100000:1.0:1787864815.902223:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890752 00000100:00100000:1.0:1787864815.902227:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890752 00000100:00100000:1.0:1787864815.902263:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890368 00000100:00100000:1.0:1787864815.902266:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890368 00000100:00100000:1.0:1787864815.902291:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787864815.902298:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744902a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844890752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.902341:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744902a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844890752:12345-0@lo:400:kworker.0 Request processed in 44us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.902347:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787864815.902359:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787864815.902373:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844890368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.902406:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844890368:12345-0@lo:400:kworker.0 Request processed in 35us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.902413:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1787864815.902430:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864815.902435:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864815.902438:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864815.902441:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864815.902466:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844890752:0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.902520:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844889984 00000100:00100000:1.0:1787864815.902525:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844889984 00000100:00100000:1.0:1787864815.902550:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787864815.902556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.902591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844889984:12345-0@lo:400:kworker.0 Request processed in 35us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.902597:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787864815.902643:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927449029e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844889344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864815.902658:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864815.902667:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844890880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864815.902714:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864815.902747:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890880 00000100:00100000:1.0:1787864815.902751:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890880 00000100:00100000:1.0:1787864815.902776:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787864815.902782:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844890880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787864815.902797:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1787864815.902832:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844890880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.902845:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787864815.902879:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844890880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864815.904823:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864815.904948:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844889856:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.904976:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844890368:0@lo:400:kworker.0 00000100:00100000:2.0:1787864815.905446:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a97c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844889984:0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.905724:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844890496 00000100:00100000:1.0:1787864815.905734:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844890496 00000100:00100000:1.0:1787864815.905811:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787864815.905821:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844890496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.905941:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844890496:12345-0@lo:400:kworker.0 Request processed in 121us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864815.905954:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:1.0:1787864815.905982:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864815.908432:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844890496:0@lo:400:kworker.0 00000100:00100000:0.0:1787864815.909118:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927449029a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844889600:12345-0@lo:400:kworker.0 Request processed in 8018us (10319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864815.909133:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787864815.909313:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3637:x1874711844889472:12345-0@lo:400:kworker.0 Request processed in 7795us (8567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864815.909323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1787864815.909476:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3637:1874711844889472:0@lo:400:kworker.0 00000100:00100000:1.0:1787864815.909618:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844889600:0@lo:400:kworker.0 00010000:00010000:3.0:1787864815.961224:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864816.153214:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864816.153226:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864816.153281:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787864816.153293:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864816.153465:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844891008:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864816.153603:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275764519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864816.160250:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.162411:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974784 00000100:00100000:1.0:1787864816.162427:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974784 00000100:00100000:1.0:1787864816.162605:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 232 00000100:00100000:1.0:1787864816.162618:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825974784:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787864816.162659:0:6511:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787864816.162836:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825974784:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 220us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.162845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 232 00000100:00100000:2.0:1787864816.166101:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844891008:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864816.166348:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.166437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825974912 00000100:00100000:1.0:1787864816.166446:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825974912 00000100:00100000:1.0:1787864816.166515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 233 00000100:00100000:1.0:1787864816.166526:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12481:x1874711825974912:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.166615:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166654:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166668:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166707:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166716:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166723:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166752:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166761:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166769:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864816.166817:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787864816.166823:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864816.166837:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166859:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166877:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166885:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.166921:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864816.166926:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167167:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167184:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864816.167188:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864816.167194:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167201:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc44241 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167219:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167225:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167231:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167236:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864816.167247:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167253:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167262:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff927447234400) 00010000:00010000:1.0:1787864816.167264:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864816.167267:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167273:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949e00/0x2fcb8c294dc44248 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167290:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167296:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167302:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167317:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864816.167320:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167326:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167335:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864816.167338:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864816.167347:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.167353:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4424f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.167461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12481:x1874711825974912:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 Request processed in 933us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.167472:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 233 00000100:00100000:0.0:1787864816.171241:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.171346:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825975168 00000100:00100000:1.0:1787864816.171358:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825975168 00000100:00100000:1.0:1787864816.171432:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 234 00000100:00100000:1.0:1787864816.171444:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+66:12481:x1874711825975168:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.171471:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864816.171495:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44256 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acca4 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.171626:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.171643:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.171657:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864816.171670:0:8448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787864816.171872:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.171882:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173431:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173439:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864816.173445:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173455:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173475:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:1.0:1787864816.173478:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787864816.173483:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173490:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949400/0x2fcb8c294dc4425d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173565:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44256 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acca4 expref: 68 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173576:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:1.0:1787864816.173579:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864816.173583:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc44256 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acca4 expref: 68 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.173593:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949c00, rc 0) 00000100:00100000:1.0:1787864816.173757:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975168:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 2314us (2527us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1787864816.173778:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 234 00000100:00100000:0.0:1787864816.182845:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.183038:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825975296 00000100:00100000:3.0:1787864816.183051:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825975296 00000100:00100000:3.0:1787864816.183131:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 235 00000100:00100000:3.0:1787864816.183165:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975296:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787864816.183317:0:6510:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787864816.183468:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975296:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 307us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864816.183477:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 235 00000100:00100000:0.0:1787864816.188649:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.188879:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825975552 00000100:00100000:1.0:1787864816.188916:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825975552 00000100:00100000:1.0:1787864816.188991:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 236 00000100:00100000:1.0:1787864816.189002:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975552:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.189028:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864816.189031:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787864816.189064:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797e00/0x2fcb8c294dc441fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc88 expref: 67 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.189088:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:1.0:1787864816.189094:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864816.189110:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4426b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accab expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864816.190074:0:6512:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787864816.190263:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44272 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.190281:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.190293:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.190359:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949000/0x2fcb8c294dc4426b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accab expref: 69 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.190377:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accab expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.190385:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c100) 00010000:00010000:0.0:1787864816.190388:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864816.190391:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba400, rc 0) 00000100:00100000:0.0:1787864816.190476:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12481:x1874711825975552:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1475us (1841us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787864816.190504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 236 00000100:00100000:0.0:1787864816.194044:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.194126:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825975808 00000100:00100000:2.0:1787864816.194138:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825975808 00000100:00100000:2.0:1787864816.194312:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 237 00000100:00100000:2.0:1787864816.194324:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12481:x1874711825975808:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.194402:0:13804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864816.194436:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44272 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accab expref: 68 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.194458:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c100) 00010000:00010000:2.0:1787864816.194471:0:13804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864816.194497:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.194512:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.194523:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195049:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195073:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195085:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195135:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195142:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195149:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195155:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864816.195159:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195167:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195178:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:2.0:1787864816.195181:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864816.195186:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195193:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44280 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195222:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195228:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195234:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195239:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864816.195242:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195249:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195256:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8bad6613 (ffff927448159e00) 00010000:00010000:2.0:1787864816.195258:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864816.195261:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.195267:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc44287 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8bad6613 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.195716:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975808:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 1390us (1680us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864816.195725:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 237 00000100:00100000:2.0:1787864816.201209:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.201723:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825975936 00000100:00100000:0.0:1787864816.201733:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825975936 00000100:00100000:0.0:1787864816.201793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 238 00000100:00100000:0.0:1787864816.201804:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+67:12481:x1874711825975936:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864816.201823:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864816.201845:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc4428e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.201882:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.201917:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.201928:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.202036:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc4428e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 69 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.202055:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 68 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.202064:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:0.0:1787864816.202067:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864816.202076:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bac00, rc 0) 00000100:00100000:0.0:1787864816.202125:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12481:x1874711825975936:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 323us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.202132:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 238 00000100:00100000:0.0:1787864816.208393:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.208464:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825976192 00000100:00100000:2.0:1787864816.208485:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825976192 00000100:00100000:2.0:1787864816.208539:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 239 00000100:00100000:2.0:1787864816.208548:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+68:12481:x1874711825976192:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.208623:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.208640:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.208652:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864816.208811:0:10168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1787864816.208861:0:10168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e298ea6 reply state 0000000023141bf4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.208874:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.208882:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:2.0:1787864816.208885:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787864816.208911:0:10168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787864816.209008:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12481:x1874711825976192:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 460us (623us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787864816.209016:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 239 00000100:00100000:0.0:1787864816.211327:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.211406:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825976320 00000100:00100000:1.0:1787864816.211414:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825976320 00000100:00100000:1.0:1787864816.211474:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 240 00000100:00100000:1.0:1787864816.211484:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+70:12481:x1874711825976320:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.211506:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864816.211524:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accb9 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.211577:0:8448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 71 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.211607:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 71 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.211625:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:1.0:1787864816.211628:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787864816.211632:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949c00, rc 0) 00000100:00100000:1.0:1787864816.211702:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12481:x1874711825976320:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 219us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.211710:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 240 00000100:00100000:2.0:1787864816.214025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.214182:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825976448 00000100:00100000:3.0:1787864816.214191:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825976448 00000100:00100000:3.0:1787864816.214262:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 70 00000100:00100000:3.0:1787864816.214272:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2410:x1874711825976448:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787864816.214462:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2410:x1874711825976448:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 191us (444us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787864816.214470:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 70 00000100:00080000:1.0:1787864816.215057:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864816.220268:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.220361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825976704 00000100:00100000:1.0:1787864816.220370:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825976704 00000100:00100000:1.0:1787864816.220428:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:1.0:1787864816.220438:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+71:12481:x1874711825976704:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787864816.220655:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+72:12481:x1874711825976704:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 217us (395us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1787864816.220662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:0.0:1787864816.224863:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.225208:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825976960 00000100:00100000:1.0:1787864816.225228:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825976960 00000100:00100000:1.0:1787864816.225291:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 241 00000100:00100000:1.0:1787864816.225301:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+72:12481:x1874711825976960:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864816.225410:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+72:12481:x1874711825976960:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 110us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.225418:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 241 00000100:00100000:3.0:1787864816.234559:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.234651:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977088 00000100:00100000:2.0:1787864816.234660:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977088 00000100:00100000:2.0:1787864816.234735:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 242 00000100:00100000:2.0:1787864816.234745:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+72:12481:x1874711825977088:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.234785:0:10168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864816.234805:0:10168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc442aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accc0 expref: -99 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235358:0:10168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235377:0:10168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235390:0:10168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864816.235437:0:10168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864816.235456:0:10168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235482:0:10168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc442aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc0 expref: 74 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235502:0:10168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc0 expref: 73 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.235510:0:10168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:2.0:1787864816.235513:0:10168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864816.235516:0:10168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387aa00, rc 0) 00000100:00100000:2.0:1787864816.235579:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+73:12481:x1874711825977088:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 836us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864816.235587:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 242 00000100:00100000:0.0:1787864816.242577:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.242769:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977216 00000100:00100000:1.0:1787864816.242787:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977216 00000100:00100000:1.0:1787864816.242864:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:1.0:1787864816.242874:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+10:2410:x1874711825977216:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.243178:0:8423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864816.243201:0:8423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accc7 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864816.243229:0:8423:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a6f0, blocks: 0x0 00010000:00010000:1.0:1787864816.243247:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787864816.243252:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864816.243262:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.243281:0:8423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 11 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.243305:0:8423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949400, rc 0) 00000100:00100000:1.0:1787864816.243531:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2410:x1874711825977216:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 658us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.243540:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 71 00000100:00100000:0.0:1787864816.248226:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.249727:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977472 00000100:00100000:1.0:1787864816.249740:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977472 00000100:00100000:1.0:1787864816.249828:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 243 00000100:00100000:1.0:1787864816.249838:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756de91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+73:12481:x1874711825977472:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864816.249983:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756de91c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+73:12481:x1874711825977472:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 145us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.250004:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 243 00000100:00100000:3.0:1787864816.254625:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.256549:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977600 00000100:00100000:1.0:1787864816.256563:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977600 00000100:00100000:1.0:1787864816.256714:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 72 00000100:00100000:1.0:1787864816.256725:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+11:12481:x1874711825977600:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.256741:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864816.256760:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accce expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.256800:0:8820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.256809:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864816.256813:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864816.256818:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 12 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.256852:0:8820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.256866:0:8820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.256881:0:8820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844891136:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864816.257026:0:8820:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864816.261995:0:8820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8820:1874711844891136:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864816.262046:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 12 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.262073:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949e00, rc 0) 00000100:00100000:1.0:1787864816.262254:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+12:12481:x1874711825977600:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 5529us (7635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.262265:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 72 00000100:00100000:0.0:1787864816.262535:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.262727:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977728 00000100:00100000:1.0:1787864816.262735:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977728 00010000:00010000:1.0:1787864816.262771:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.262812:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00100000:1.0:1787864816.262822:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+12:2409:x1874711825977728:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864816.262839:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864816.262871:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.262908:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.262937:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc442b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc7 expref: 12 pid: 8423 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.262954:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864816.262977:0:6498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864816.262989:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 11 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.263001:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 11 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.263043:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 11 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.263061:0:6498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1874711844891264:192.168.206.36@tcp:105: 00000100:00100000:1.0:1787864816.263135:0:6498:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70780 going to sleep for 11 seconds 00000100:00100000:2.0:1787864816.268924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.269077:0:6498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6498:1874711844891264:192.168.206.36@tcp:105: 00010000:00010000:0.0:1787864816.269113:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864816.269182:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2409:x1874711825977728:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 6360us (6646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.269203:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 103 00000100:00100000:3.0:1787864816.270495:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977856 00000100:00100000:3.0:1787864816.270512:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977856 00002000:00100000:3.0:1787864816.270578:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9274490f0b40 x1874711825977856/t0(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:667/0 lens 504/0 e 0 to 0 dl 1787864827 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787864816.270592:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490f0b40 with x1874711825977856 ext(0->12) 00002000:00010000:3.0:1787864816.270598:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9274490f0b40 00000100:00100000:3.0:1787864816.270695:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:3.0:1787864816.270706:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+11:2409:x1874711825977856:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787864816.271827:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+13:2409:x1874711825977856:12345-192.168.206.36@tcp:4:lhsmtool_posix.0 Request processed in 1114us (2932us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787864816.271858:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00002000:00100000:3.0:1787864816.271868:0:8431:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9274490f0b40 x1874711825977856/t4294967321(0) o4->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:667/0 lens 504/448 e 0 to 0 dl 1787864827 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787864816.271880:0:8431:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff9274490f0b40 with x1874711825977856 ext(0->12) 00002000:00010000:3.0:1787864816.271885:0:8431:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9274490f0b40 00000100:00100000:2.0:1787864816.274536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.274652:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825977984 00000100:00100000:1.0:1787864816.274663:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825977984 00000100:00100000:1.0:1787864816.274772:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 244 00000100:00100000:1.0:1787864816.274784:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+73:12481:x1874711825977984:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787864816.277032:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1787864816.277061:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1787864816.277103:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787864816.277130:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff927448331cc0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787864816.277136:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744724e000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff927448331240 00000020:00080000:1.0:1787864816.277140:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744724e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92755fbe2c00 00000020:00080000:1.0:1787864816.277203:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff927448283480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787864816.277206:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744725aa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff927448283180 00000020:00080000:1.0:1787864816.277209:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744725af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9275588fa600 00000020:00080000:1.0:1787864816.277234:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1787864816.277402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12481:x1874711825977984:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 Request processed in 2615us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.277415:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 244 00000100:00100000:2.0:1787864816.277648:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864816.277668:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844891392:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787864816.277750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864816.277804:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844891392 00000100:00100000:2.0:1787864816.277811:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844891392 00000100:00100000:2.0:1787864816.277869:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787864816.277878:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3637:x1874711844891392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787864816.277936:0:14166:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1787864816.277989:0:14166:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a90a6ee, atime: 0x6a90a6ee, ctime: 0x6a90a6ee, blocks: 0x8 00010000:00010000:2.0:1787864816.277998:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.278017:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787864816.278023:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864816.278031:0:14166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.278050:0:14166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.278061:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.278069:0:14166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.278103:0:14166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787864816.278412:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3637:x1874711844891392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 533us (660us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787864816.278420:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1787864816.278466:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9274490f1680/2, rc 0, transno 4294967311 00000100:00100000:2.0:1787864816.278472:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844891392:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787864816.279307:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864816.279319:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279334:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864816.279339:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279352:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279395:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279403:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc442c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279434:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864816.279436:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864816.279438:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864816.279447:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864816.279467:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844891520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787864816.279539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864816.279591:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844891520 00000100:00100000:0.0:1787864816.279597:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844891520 00000100:00100000:0.0:1787864816.279724:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787864816.279734:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844891520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787864816.279762:0:8423:0:(ofd_dev.c:1866:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1787864816.279786:0:8423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279805:0:8423:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 12 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279814:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787864816.279819:0:8423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787864816.279824:0:8423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279863:0:8423:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 12 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.279878:0:8423:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 12 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.279926:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874711844891648:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864816.279987:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e453c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787864816.281297:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281317:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281326:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281333:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.281338:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281347:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281367:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff927549cf1f00) 00010000:00010000:3.0:1787864816.281370:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.281376:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281383:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031400/0x2fcb8c294dc43fc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281419:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281440:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281446:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281451:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ec00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.281454:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281460:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281474:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff927566faae00) 00010000:00010000:3.0:1787864816.281476:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.281479:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281485:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824ec00/0x2fcb8c294dc4406c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281503:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281509:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281515:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281521:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.281529:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281536:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281543:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:3.0:1787864816.281546:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.281549:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281554:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030800/0x2fcb8c294dc440ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281567:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281573:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281579:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281585:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.281587:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281593:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281606:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927448159400) 00010000:00010000:3.0:1787864816.281608:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.281617:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281623:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc4410d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281642:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281649:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281655:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281660:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.281663:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281668:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281676:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864816.281691:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.281694:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.281700:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc441df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787864816.282088:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:3.0:1787864816.282436:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282446:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282467:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282473:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.282477:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282483:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282494:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:3.0:1787864816.282497:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787864816.282501:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.282507:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031600/0x2fcb8c294dc4429c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10168 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787864816.284042:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787864816.284322:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.284405:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.284691:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825978112 00000100:00100000:2.0:1787864816.284703:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825978112 00000100:00100000:2.0:1787864816.284772:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 75 00000100:00100000:2.0:1787864816.284783:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+13:2410:x1874711825978112:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787864816.285641:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8423:1874711844891648:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864816.285677:0:8423:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.285767:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825978240 00000100:00100000:3.0:1787864816.285781:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825978240 00010000:00010000:3.0:1787864816.285827:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 14 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.285928:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 104 00000100:00100000:0.0:1787864816.285935:0:6497:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787864816.285944:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+14:2409:x1874711825978240:12345-192.168.206.36@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787864816.285951:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787864816.285964:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864816.285973:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 14 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.286013:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 14 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.286036:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002479b29/0x2fcb8c294dc4407a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc26 expref: 14 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.286054:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864816.286059:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864816.286065:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.286074:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.286595:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864816.286666:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+13:2409:x1874711825978240:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 727us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864816.286675:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 104 00010000:00010000:0.0:1787864816.286866:0:8423:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.286883:0:8423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.286927:0:8423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.286949:0:8423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.286969:0:8423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787864816.287227:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874711844891520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7491us (7685us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787864816.287239:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1787864816.287651:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9274490c4000/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787864816.287748:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844891520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1787864816.288166:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864816.288178:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.288191:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bbc00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864816.288196:0:10329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.288206:0:10329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.288225:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.288233:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1348892/0x2fcb8c294dc442cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.288258:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864816.288260:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864816.288262:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787864816.295322:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787864816.295352:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1787864816.295619:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825978112:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 Request processed in 10827us (11293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864816.295633:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 75 00000100:00100000:1.0:1787864816.298272:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.298574:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825978496 00000100:00100000:0.0:1787864816.298587:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825978496 00000100:00100000:0.0:1787864816.298662:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 245 00000100:00100000:0.0:1787864816.298674:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12481:x1874711825978496:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787864816.298765:0:6512:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864816.298802:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387aa00/0x2fcb8c294dc442b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accc0 expref: 21 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.298826:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:0.0:1787864816.298832:0:6512:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787864816.298871:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.298932:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.298945:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787864816.299454:0:6512:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd333b69 reply state 000000006440319a transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.299472:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.299479:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:0.0:1787864816.299482:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864816.299486:0:6512:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864816.299612:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+22:12481:x1874711825978496:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 938us (1350us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1787864816.299621:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 245 00000100:00100000:0.0:1787864816.303986:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.304189:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825978624 00000100:00100000:3.0:1787864816.304204:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825978624 00000100:00100000:2.0:1787864816.304554:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:2.0:1787864816.304575:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2410:x1874711825978624:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787864816.304789:0:8425:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787864816.304794:0:8425:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787864815 00002000:00010000:2.0:1787864816.304796:0:8425:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787864814 00002000:00010000:2.0:1787864816.304799:0:8425:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787864816 -> 1787864815 00002000:00010000:2.0:1787864816.304801:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787864816.304877:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825978624:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 311us (904us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787864816.304912:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 76 00000100:00100000:3.0:1787864816.310538:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.312820:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825978880 00000100:00100000:1.0:1787864816.312969:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825978880 00000100:00100000:1.0:1787864816.313113:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 246 00000100:00100000:1.0:1787864816.313124:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:12481:x1874711825978880:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787864816.313200:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.313217:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.313227:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.313272:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.313285:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 22 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.313298:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb68f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844891776:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864816.313380:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864816.316245:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.316415:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb68f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8448:1874711844891776:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864816.316441:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.316532:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979008 00000100:00100000:0.0:1787864816.316541:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979008 00010000:00010000:0.0:1787864816.316574:0:6498:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 23 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.316613:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 105 00000100:00100000:0.0:1787864816.316622:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+23:2409:x1874711825979008:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864816.316652:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864816.316659:0:6498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 23 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316671:0:6498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 23 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316725:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb2 expref: 23 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316739:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:0.0:1787864816.316743:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316752:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316769:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.316795:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864816.316843:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2409:x1874711825979008:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 222us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.316851:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 105 00010000:00010000:2.0:1787864816.317033:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317041:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317079:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317086:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317092:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317098:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864816.317102:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317110:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317119:0:8448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:2.0:1787864816.317121:0:8448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787864816.317125:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.317130:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948c00/0x2fcb8c294dc442db lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.317194:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12481:x1874711825978880:12345-192.168.206.36@tcp:55:lhsmtool_posix.0 Request processed in 4072us (6663us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787864816.317202:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 246 00000100:00100000:1.0:1787864816.326435:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.326572:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979136 00000100:00100000:2.0:1787864816.326581:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979136 00000100:00100000:2.0:1787864816.326634:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 77 00000100:00100000:2.0:1787864816.326645:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825979136:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.326698:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.326718:0:14166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.326727:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864816.326731:0:14166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787864816.326735:0:14166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.326772:0:14166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 8 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.326786:0:14166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 8 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.326800:0:14166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14166:1874711844891904:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864816.326931:0:14166:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864816.330931:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.331034:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979264 00000100:00100000:3.0:1787864816.331042:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979264 00010000:00010000:3.0:1787864816.331094:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 9 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.331193:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 106 00000100:00100000:3.0:1787864816.331207:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+9:2409:x1874711825979264:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864816.331232:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864816.331253:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 9 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.331269:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 9 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.331293:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864816.331298:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787864816.331304:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.331314:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.331334:0:14166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc442bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accce expref: 9 pid: 8820 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.331335:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864816.331354:0:14166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:14166:1874711844891904:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864816.331377:0:14166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.331389:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2409:x1874711825979264:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 182us (464us total) trans 0 rc 0/0 00010000:00010000:1.0:1787864816.331400:0:14166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.331404:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 106 00010000:00010000:1.0:1787864816.331413:0:14166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.331433:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.331442:0:14166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.331449:0:14166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.333720:0:14166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387aa00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864816.333728:0:14166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.333741:0:14166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.333809:0:14166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864816.333837:0:14166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000247f88d6/0x2fcb8c294dc442e2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.333952:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2409:x1874711825979136:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 Request processed in 7306us (7521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.333962:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 77 00000100:00100000:3.0:1787864816.336513:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.336699:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979520 00000100:00100000:2.0:1787864816.336707:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979520 00000100:00100000:2.0:1787864816.336814:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 247 00000100:00100000:2.0:1787864816.336825:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+21:12481:x1874711825979520:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.336933:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.336950:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 21 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.336960:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.336993:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 21 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.337007:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 21 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.337020:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892032:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864816.337096:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864816.340599:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.340707:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979648 00000100:00100000:0.0:1787864816.340715:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979648 00010000:00010000:0.0:1787864816.340752:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.340794:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 107 00000100:00100000:0.0:1787864816.340804:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576456c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2410:x1874711825979648:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864816.340819:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864816.340826:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340864:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340886:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864816.340933:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340944:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340952:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340959:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.340978:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864816.341027:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576456c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2410:x1874711825979648:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 224us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.341035:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 107 00010000:00010000:2.0:1787864816.341347:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948400/0x2fcb8c294dc441d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc7a expref: 21 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.341364:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892032:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864816.341385:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341401:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341408:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341571:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341584:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 21 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341592:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341621:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 21 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.341634:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 21 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.341647:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892160:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864816.341720:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01600 going to sleep for 11 seconds 00000100:00100000:2.0:1787864816.346041:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.346053:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892160:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864816.346091:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.346405:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979776 00000100:00100000:0.0:1787864816.346412:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979776 00010000:00010000:0.0:1787864816.346444:0:14659:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.346494:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 108 00000100:00100000:0.0:1787864816.346503:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2409:x1874711825979776:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864816.346529:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864816.346536:0:14659:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346549:0:14659:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346570:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d949c00/0x2fcb8c294dc442a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accb9 expref: 22 pid: 8448 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346585:0:14659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:0.0:1787864816.346590:0:14659:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346599:0:14659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346606:0:14659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.346633:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864816.346696:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+21:2409:x1874711825979776:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 193us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.346705:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 108 00010000:00010000:3.0:1787864816.347040:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.347049:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864816.347151:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1787864816.350364:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1787864816.350427:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1787864816.350512:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1874711844892288:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787864816.350577:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864816.350627:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc01300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864816.350810:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844892288 00000100:00100000:1.0:1787864816.350817:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844892288 00000100:00100000:1.0:1787864816.350925:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787864816.350937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1874711844892288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787864816.351019:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6510:x1874711844892288:12345-0@lo:1000:mdt00_000.0 Request processed in 85us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.351026:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787864816.351117:0:6510:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1787864816.351123:0:6510:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1787864816.351144:0:6510:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9274490c4000 x1874711844891520/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787864832 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864816.351157:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1874711844892288:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787864816.351271:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1787864816.351314:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1874711844892416:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787864816.351342:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864816.351568:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275428b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787864816.351626:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844892416 00000100:00100000:0.0:1787864816.351632:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844892416 00000100:00100000:0.0:1787864816.351654:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787864816.351661:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6510:x1874711844892416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787864816.351774:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6510:x1874711844892416:12345-0@lo:1000:mdt00_000.0 Request processed in 113us (431us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787864816.351790:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787864816.351970:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490f2580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6510:1874711844892416:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787864816.352003:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352013:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352021:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352028:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387b400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864816.352032:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352041:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352056:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:2.0:1787864816.352060:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864816.352071:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352078:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc442f0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352102:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352109:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352114:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352118:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864816.352120:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352125:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352133:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864816.352135:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864816.352142:0:6510:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352153:0:6510:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352162:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.352212:0:6510:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864816.352224:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892544:192.168.206.36@tcp:105: 00000100:00100000:2.0:1787864816.352279:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275428b3840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864816.356468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.356536:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825979904 00000100:00100000:1.0:1787864816.356544:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825979904 00000100:00100000:1.0:1787864816.356598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:1.0:1787864816.356608:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12480:x1874711825979904:12345-192.168.206.36@tcp:49:lfs.0 00000100:00100000:1.0:1787864816.356748:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12480:x1874711825979904:12345-192.168.206.36@tcp:49:lfs.0 Request processed in 141us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.357089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:0.0:1787864816.358641:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6510:1874711844892544:192.168.206.36@tcp:105: 00010000:00010000:0.0:1787864816.358673:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358694:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44233 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358727:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358741:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358752:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358763:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358770:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358777:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358783:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864816.358787:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.358794:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864816.362719:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864816.362814:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825980160 00000100:00100000:1.0:1787864816.362822:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825980160 00000100:00100000:1.0:1787864816.362910:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 248 00000100:00100000:1.0:1787864816.362920:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12480:x1874711825980160:12345-192.168.206.36@tcp:58:lfs.0 00000040:00080000:1.0:1787864816.363084:0:10168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787864816.363157:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12480:x1874711825980160:12345-192.168.206.36@tcp:58:lfs.0 Request processed in 239us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864816.363166:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 248 00010000:00010000:0.0:1787864816.363883:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864816.363902:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787864816.363912:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363922:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc442f7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363942:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363949:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363956:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363962:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864816.363966:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363974:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.363989:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864816.363992:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864816.363995:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.364002:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a200/0x2fcb8c294dc442e9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.364242:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+24:12481:x1874711825979520:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 27418us (27735us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787864816.364251:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 247 00000020:00080000:0.0:1787864816.364257:0:6510:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787864816.370569:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864816.370578:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864816.370602:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787864816.370608:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787864816.370741:0:13785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844892672:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787864816.371724:0:13785:0:(client.c:2715:ptlrpc_set_wait()) set ffff927576451240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864816.372585:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.375989:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825980416 00000100:00100000:3.0:1787864816.376002:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825980416 00000100:00100000:3.0:1787864816.376060:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 62 00000100:00100000:3.0:1787864816.376071:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+25:12481:x1874711825980416:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787864816.376339:0:6514:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787864816.376373:0:6514:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1787864816.376406:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376423:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376435:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376457:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376464:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376471:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376494:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787864816.376575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12481:x1874711825980416:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 505us (3993us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787864816.376583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 62 00000020:00080000:3.0:1787864816.376587:0:6514:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787864816.376635:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864816.376641:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376647:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864816.376651:0:10328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376658:0:10328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376670:0:10328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:3.0:1787864816.376673:0:10328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787864816.376677:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376704:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc442fe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6514 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.376720:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864816.376723:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864816.376724:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864816.377013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.377209:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825980544 00000100:00100000:0.0:1787864816.377215:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825980544 00000100:00100000:0.0:1787864816.377263:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 249 00000100:00100000:3.0:1787864816.377270:0:13785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491bbc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13785:1874711844892672:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787864816.377271:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+27:12482:x1874711825980544:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787864816.377291:0:13804:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787864816.377367:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+26:12482:x1874711825980544:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.377374:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 249 00000100:00100000:1.0:1787864816.394326:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864816.394489:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825980800 00000100:00100000:2.0:1787864816.394499:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825980800 00000100:00100000:2.0:1787864816.394558:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 250 00000100:00100000:2.0:1787864816.394569:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+26:12482:x1874711825980800:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864816.394591:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864816.394610:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc44305 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accd5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.394713:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b800/0x2fcb8c294dc4430c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.394726:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b800/0x2fcb8c294dc4430c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.394737:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b800/0x2fcb8c294dc4430c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864816.394747:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787864816.394842:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b400/0x2fcb8c294dc44305 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accd5 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.394940:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b800/0x2fcb8c294dc4430c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accd5 expref: 28 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864816.394948:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:2.0:1787864816.394951:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787864816.394955:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387b800, rc 0) 00000100:00100000:0.0:1787864816.395861:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+28:12482:x1874711825980800:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 1289us (1540us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787864816.395871:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 250 00000100:00100000:3.0:1787864816.396091:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.396138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825980928 00000100:00100000:0.0:1787864816.396144:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825980928 00000100:00100000:0.0:1787864816.396179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 251 00000100:00100000:0.0:1787864816.396187:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+28:12484:x1874711825980928:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864816.396199:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864816.396222:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc4431a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accdc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396277:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396302:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396312:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396326:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396343:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396348:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396418:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396429:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396438:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396485:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.396499:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 29 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.396523:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844892800:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864816.396590:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864816.400853:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6512:1874711844892800:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864816.400885:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864816.401046:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.401337:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825981184 00000100:00100000:3.0:1787864816.401344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825981184 00000100:00100000:3.0:1787864816.401396:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:3.0:1787864816.401406:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+30:6197:x1874711825981184:12345-192.168.206.36@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787864816.401617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+31:6197:x1874711825981184:12345-192.168.206.36@tcp:35:ldlm_bl.0 Request processed in 211us (570us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787864816.401625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:3.0:1787864816.405538:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.405732:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825981440 00000100:00100000:0.0:1787864816.405742:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825981440 00000100:00100000:0.0:1787864816.405801:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 252 00000100:00100000:0.0:1787864816.405810:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+31:12482:x1874711825981440:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787864816.405880:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.405932:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.405942:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406070:0:13804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406078:0:13804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406084:0:13804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406105:0:13804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bac00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864816.406108:0:13804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406115:0:13804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406125:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864816.406127:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787864816.406131:0:13804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.406137:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bac00/0x2fcb8c294dc44336 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.406243:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:545fdf19-2645-4c06-a6f5-05dea3348b20+32:12482:x1874711825981440:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 434us (713us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787864816.406251:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 252 00000040:00080000:3.0:1787864816.406390:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864816.406394:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864816.406881:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787864816.406911:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787864816.408564:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864816.408633:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825981568 00000100:00100000:0.0:1787864816.408642:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825981568 00010000:00010000:0.0:1787864816.408676:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 32 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.408723:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 109 00000100:00100000:0.0:1787864816.408733:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+32:2410:x1874711825981568:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864816.408747:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864816.408753:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 32 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408785:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 32 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408804:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030600/0x2fcb8c294dc44225 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc96 expref: 32 pid: 6511 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408818:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864816.408822:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408830:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408836:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864816.408869:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864816.408923:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.408931:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864816.408936:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+31:2410:x1874711825981568:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 206us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.408943:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 109 00000004:00200000:3.0:1787864816.408973:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787864816.408983:0:6512:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864816.409005:0:6512:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409016:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409025:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409031:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409038:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409045:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.409049:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409055:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409064:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864816.409066:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.409070:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409075:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb800/0x2fcb8c294dc44321 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409085:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409102:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409114:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409118:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864816.409121:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409127:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409134:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff927548d9ca00) 00010000:00010000:3.0:1787864816.409136:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864816.409139:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409144:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb600/0x2fcb8c294dc44328 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409176:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc4431a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accdc expref: 31 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409202:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accdc expref: 30 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864816.409210:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864816.409212:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864816.409220:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5ba200, rc 0) 00000100:00100000:3.0:1787864816.409245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+30:12484:x1874711825980928:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 13059us (13155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864816.409251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 251 00000100:00100000:1.0:1787864816.410774:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864816.410853:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825981824 00000100:00100000:3.0:1787864816.410859:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825981824 00000100:00100000:3.0:1787864816.410936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:3.0:1787864816.410945:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+30:12482:x1874711825981824:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787864816.411136:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+31:12482:x1874711825981824:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 192us (369us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787864816.411143:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:0.0:1787864816.921858:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864816.921880:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844892928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864816.921959:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864816.922017:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844892928 00000100:00100000:0.0:1787864816.922023:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844892928 00000100:00100000:0.0:1787864816.922065:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787864816.922073:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844892928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864816.922115:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864816.922160:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844892928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864816.922167:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787864816.922211:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844892928:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787864816.992315:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864817.088812:0:14697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864817.088821:0:14697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864817.088970:0:14697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787864817.088977:0:14697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787864817.124416:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1787864817.124432:0:8419:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1787864817.281670:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864817.281720:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982080 00000100:00100000:2.0:1787864817.281800:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982080 00000100:00100000:0.0:1787864817.281873:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 253 00000100:00100000:0.0:1787864817.281989:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+31:12508:x1874711825982080:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:0.0:1787864817.282015:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864817.282034:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4433d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acce3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.282128:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44344 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787864817.282140:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787864817.282143:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44344 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.282155:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44344 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864817.282165:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787864817.282380:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbc00/0x2fcb8c294dc4433d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acce3 expref: 34 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.282397:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44344 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acce3 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.282406:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864817.282416:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787864817.282420:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbe00, rc 0) 00000100:00100000:0.0:1787864817.282490:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12508:x1874711825982080:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 506us (826us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787864817.282497:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 253 00000100:00100000:3.0:1787864817.284685:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864817.284755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982208 00000100:00100000:0.0:1787864817.284763:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982208 00000100:00100000:0.0:1787864817.284859:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 254 00000100:00100000:0.0:1787864817.284868:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12508:x1874711825982208:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:0.0:1787864817.284955:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.284971:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.284982:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285012:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285019:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285030:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285036:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:0.0:1787864817.285040:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285059:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285069:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:0.0:1787864817.285072:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787864817.285076:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864817.285083:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864817.285150:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12508:x1874711825982208:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864817.285158:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 254 00000100:00100000:2.0:1787864817.378650:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864817.379042:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982336 00000100:00100000:1.0:1787864817.379051:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982336 00000100:00100000:1.0:1787864817.379100:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 78 00000100:00100000:1.0:1787864817.379109:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2407:x1874711825982336:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:1.0:1787864817.379124:0:8820:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864817.379142:0:8820:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc44359 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accea expref: -99 pid: 8820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864817.379165:0:8820:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a90a6ef, atime: 0x6a90a6ee, ctime: 0x6a90a6ef, blocks: 0x8 00010000:00010000:1.0:1787864817.379183:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1787864817.379187:0:8820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864817.379196:0:8820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc44359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accea expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864817.379214:0:8820:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc44359 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accea expref: 8 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864817.379245:0:8820:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949c00, rc 0) 00000100:00100000:1.0:1787864817.379342:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2407:x1874711825982336:12345-192.168.206.36@tcp:101:cat.0 Request processed in 233us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864817.379349:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 78 00000100:00100000:2.0:1787864817.392346:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864817.396520:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982464 00000100:00100000:0.0:1787864817.396533:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982464 00002000:00100000:0.0:1787864817.396585:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff927448a95e00 x1874711825982464/t0(0) o3->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:668/0 lens 488/0 e 0 to 0 dl 1787864828 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864817.396597:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448a95e00 with x1874711825982464 ext(0->4095) 00002000:00010000:0.0:1787864817.396602:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448a95e00 00000100:00100000:0.0:1787864817.396759:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864817.396769:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825982464:12345-192.168.206.36@tcp:3:cat.0 00000100:00100000:0.0:1787864817.396961:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+8:2410:x1874711825982464:12345-192.168.206.36@tcp:3:cat.0 Request processed in 193us (4623us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787864817.396970:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00002000:00100000:0.0:1787864817.396976:0:8430:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff927448a95e00 x1874711825982464/t0(0) o3->545fdf19-2645-4c06-a6f5-05dea3348b20@192.168.206.36@tcp:668/0 lens 488/4536 e 0 to 0 dl 1787864828 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787864817.397003:0:8430:0:(ofd_dev.c:2572:ofd_prolong_extent_locks()) Prolong locks for req ffff927448a95e00 with x1874711825982464 ext(0->4095) 00002000:00010000:0.0:1787864817.397017:0:8430:0:(ofd_dev.c:2721:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff927448a95e00 00000100:00100000:1.0:1787864817.434517:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864817.434539:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844893056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864817.434605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864817.434779:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864817.434805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864817.435116:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893056 00000100:00100000:1.0:1787864817.435123:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893056 00000100:00100000:1.0:1787864817.435173:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893184 00000100:00100000:1.0:1787864817.435177:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893184 00000100:00100000:1.0:1787864817.435194:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787864817.435202:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844893056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864817.435230:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864817.435273:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844893056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864817.436782:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787864817.436806:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844893184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864817.436828:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864817.437186:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844893184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 391us (2378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864817.437194:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787864817.437257:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787864817.437262:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000100:00100000:1.0:1787864817.437598:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787864817.437630:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787864817.438367:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff927448bfcf00, transno 4294967308 00000004:00080000:0.0:1787864817.438393:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1787864817.438408:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9274490f1680, transno 4294967311 00000100:00100000:0.0:1787864817.438424:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864817.438450:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844893056:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787864818.009733:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864818.269712:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269769:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269786:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269804:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269836:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864818.269862:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982848 00000100:00100000:2.0:1787864818.269870:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982848 00000100:00100000:2.0:1787864818.269979:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983104 00000100:00100000:2.0:1787864818.269983:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983104 00000100:00100000:2.0:1787864818.270000:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982720 00000100:00100000:2.0:1787864818.270003:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982720 00000100:00100000:2.0:1787864818.270024:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983232 00000100:00100000:2.0:1787864818.270026:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983232 00000100:00100000:2.0:1787864818.270054:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 296 00000100:00100000:2.0:1787864818.270062:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825982848:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864818.270129:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825982848:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 67us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864818.270138:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 296 00000100:00100000:2.0:1787864818.270156:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 297 00000100:00100000:2.0:1787864818.270165:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825983104:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864818.270177:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982592 00000100:00100000:2.0:1787864818.270193:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825983104:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864818.270202:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982592 00000100:00100000:2.0:1787864818.270204:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 297 00000100:00100000:2.0:1787864818.270223:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 298 00000100:00100000:2.0:1787864818.270235:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+33:2408:x1874711825982720:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864818.270266:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+33:2408:x1874711825982720:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864818.270275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 385 00000100:00100000:2.0:1787864818.270281:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 298 00000100:00100000:3.0:1787864818.270295:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825982592:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864818.270305:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 299 00000100:00100000:2.0:1787864818.270317:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825983232:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864818.270365:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825982592:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 76us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864818.270374:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 385 00000100:00100000:0.0:1787864818.270406:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825982976 00000100:00100000:0.0:1787864818.270413:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825982976 00000100:00100000:0.0:1787864818.270468:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:0.0:1787864818.270475:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825982976:12345-192.168.206.36@tcp:400:kworker.0 00000100:00080000:1.0:1787864818.273070:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864818.273079:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864818.273082:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787864818.273170:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825983232:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2851us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864818.273183:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 299 00000100:00100000:0.0:1787864818.278082:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825982976:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 7597us (8266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864818.278096:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:2.0:1787864818.458324:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844893312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864818.458395:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864818.458494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893312 00000100:00100000:3.0:1787864818.458502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893312 00000100:00100000:3.0:1787864818.458556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787864818.458572:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844893312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864818.458619:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787864818.458697:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844893312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864818.458705:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787864818.458788:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844893312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864819.034828:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864820.059485:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787864821.017381:0:9930:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346079489323ns, next at 347079487078ns, rc = 0 00000100:00100000:3.0:1787864821.017410:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844893440:0@lo:400:kworker.0 00000100:00100000:1.0:1787864821.017410:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844893824:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017480:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844893568:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017515:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017563:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844894080:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017586:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017608:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844894720:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017629:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017647:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844895104:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017682:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017706:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787864821.017712:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844893696:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017734:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017749:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844894208:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.017767:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017784:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844894592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864821.017805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017820:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844895232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864821.017840:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.017870:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895104 00000100:00100000:0.0:1787864821.017877:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895104 00000100:00100000:0.0:1787864821.017950:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787864821.017959:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844895104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018008:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844895104:12345-0@lo:400:kworker.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018016:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787864821.018035:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893696 00000100:00100000:0.0:1787864821.018039:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893696 00000100:00100000:0.0:1787864821.018067:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787864821.018073:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844893696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018106:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844893696:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018112:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787864821.018128:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893568 00000100:00100000:0.0:1787864821.018131:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893568 00000100:00100000:0.0:1787864821.018153:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894080 00000100:00100000:0.0:1787864821.018156:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894080 00000100:00100000:0.0:1787864821.018173:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894720 00000100:00100000:0.0:1787864821.018175:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894720 00000100:00100000:0.0:1787864821.018187:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894208 00000100:00100000:0.0:1787864821.018190:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894208 00000100:00100000:0.0:1787864821.018203:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787864821.018209:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844893568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018237:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844893568:12345-0@lo:400:kworker.0 Request processed in 28us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018243:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1787864821.018255:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787864821.018261:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844894080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018286:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844894080:12345-0@lo:400:kworker.0 Request processed in 26us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018292:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1787864821.018302:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787864821.018307:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844894720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018331:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844894720:12345-0@lo:400:kworker.0 Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018345:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787864821.018356:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787864821.018362:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844894208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018390:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844894208:12345-0@lo:400:kworker.0 Request processed in 28us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018395:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787864821.018410:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894592 00000100:00100000:0.0:1787864821.018414:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894592 00000100:00100000:0.0:1787864821.018433:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895232 00000100:00100000:0.0:1787864821.018435:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895232 00000100:00100000:0.0:1787864821.018447:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787864821.018452:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844894592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864821.018470:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787864821.018500:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1874711844894592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018505:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787864821.018516:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787864821.018522:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844895232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864821.018530:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787864821.018552:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844895232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 30us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018557:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1787864821.018576:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864821.018580:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864821.018582:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864821.018603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.018632:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844894336:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.018687:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844894848:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.018733:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894336 00000100:00100000:0.0:1787864821.018737:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894336 00000100:00100000:0.0:1787864821.018762:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787864821.018768:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844894336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018800:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844894336:12345-0@lo:400:kworker.0 Request processed in 32us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018806:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787864821.018822:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893824 00000100:00100000:0.0:1787864821.018826:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893824 00000100:00100000:0.0:1787864821.018843:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894848 00000100:00100000:0.0:1787864821.018845:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894848 00000100:00100000:0.0:1787864821.018858:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787864821.018863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844893824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018913:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844893824:12345-0@lo:400:kworker.0 Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018919:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1787864821.018931:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787864821.018936:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844894848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.018961:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844894848:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.018967:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00080000:0.0:1787864821.018982:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864821.018984:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864821.019016:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844893824:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019027:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844894336:0@lo:400:kworker.0 00010000:00080000:0.0:1787864821.019037:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448185680 x1874711844894848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864821.019048:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844894848:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019080:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844893696:0@lo:400:kworker.0 00010000:00080000:0.0:1787864821.019090:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274481843c0 x1874711844894208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864821.019098:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844894208:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019112:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491ba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844894592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864821.019124:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844895232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864821.019134:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844893568:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019143:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844894080:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019153:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844894720:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019161:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844895104:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864821.019302:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844893952:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864821.019343:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844894464:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019363:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864821.019380:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844894976:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019399:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864821.019447:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893952 00000100:00100000:3.0:1787864821.019451:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893952 00000100:00100000:3.0:1787864821.019476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787864821.019482:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844893952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019517:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844893952:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864821.019523:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787864821.019539:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894464 00000100:00100000:3.0:1787864821.019542:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894464 00000100:00100000:3.0:1787864821.019566:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844894976 00000100:00100000:3.0:1787864821.019569:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844894976 00000100:00100000:3.0:1787864821.019583:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864821.019589:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844894464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019627:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844894464:12345-0@lo:400:kworker.0 Request processed in 38us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864821.019633:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787864821.019644:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787864821.019650:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019687:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844894976:12345-0@lo:400:kworker.0 Request processed in 38us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864821.019694:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1787864821.019708:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864821.019730:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844893952:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019739:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844894464:0@lo:400:kworker.0 00000100:00100000:3.0:1787864821.019746:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844894976:0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019870:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844893440 00000100:00100000:0.0:1787864821.019874:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844893440 00000100:00100000:0.0:1787864821.019916:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1787864821.019923:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864821.019958:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3640:x1874711844893440:12345-0@lo:400:kworker.0 Request processed in 36us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.019973:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1787864821.022019:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3640:1874711844893440:0@lo:400:kworker.0 00010000:00010000:2.0:1787864821.086545:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864821.338697:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864821.340755:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983360 00000100:00100000:0.0:1787864821.340767:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983360 00000100:00100000:0.0:1787864821.340849:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 255 00000100:00100000:0.0:1787864821.340859:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12169:x1874711825983360:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787864821.340985:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12169:x1874711825983360:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 Request processed in 127us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.340992:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 255 00000100:00080000:3.0:1787864821.341059:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864821.343625:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864821.343856:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983488 00000100:00100000:0.0:1787864821.343865:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983488 00000100:00100000:0.0:1787864821.344070:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 256 00000100:00100000:0.0:1787864821.344080:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:12169:x1874711825983488:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787864821.344183:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:12169:x1874711825983488:12345-192.168.206.36@tcp:60:lhsmtool_posix.0 Request processed in 104us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864821.344191:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 256 00000100:00080000:3.0:1787864821.344556:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864821.350179:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864821.351849:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983744 00000100:00100000:1.0:1787864821.351860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983744 00000100:00100000:1.0:1787864821.351965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 65 00000100:00100000:1.0:1787864821.351976:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+33:12169:x1874711825983744:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787864821.352216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+34:12169:x1874711825983744:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 243us (2043us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787864821.352225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 65 00000001:00080000:3.0:1787864821.355343:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000004:00080000:3.0:1787864821.355357:0:6490:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787864821.355393:0:6490:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92757dc01300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787864821.355399:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744724e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92757dc01cc0 00000020:00080000:3.0:1787864821.355403:0:6490:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92744724ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92744813dc00 00000020:00080000:3.0:1787864821.355424:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787864821.355474:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787864821.355548:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787864821.355831:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864821.355850:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844895360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787864821.355955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864821.356199:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895360 00000100:00100000:0.0:1787864821.356205:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895360 00000100:00100000:0.0:1787864821.356254:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787864821.356264:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874711844895360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787864821.356382:0:8423:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787864821.356386:0:8423:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1787864815 -> 1787864815 00002000:00010000:0.0:1787864821.356389:0:8423:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1787864814 -> 1787864814 00002000:00010000:0.0:1787864821.356391:0:8423:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1787864815 -> 1787864815 00002000:00010000:0.0:1787864821.356393:0:8423:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1787864821.356438:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3640:x1874711844895360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (484us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787864821.356452:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000004:00080000:0.0:1787864821.356497:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9274490c6d00/2, rc 0, transno 4294967325 00000100:00100000:0.0:1787864821.356503:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844895360:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787864821.356712:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356723:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356730:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356735:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bba00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864821.356739:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356748:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356764:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff927548d9c000) 00010000:00010000:2.0:1787864821.356767:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864821.356772:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864821.356779:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc442d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787864821.359091:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1787864821.359107:0:9504:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1787864821.561041:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864821.561293:0:13804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825983872 00000100:00100000:3.0:1787864821.561306:0:13804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825983872 00000100:00080000:0.0:1787864821.561391:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864821.561411:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 257 00000100:00100000:3.0:1787864821.561425:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:12965:x1874711825983872:12345-192.168.206.36@tcp:101:lsof.0 00010000:00010000:3.0:1787864821.561452:0:13804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864821.561480:0:13804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44360 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6accf1 expref: -99 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.561713:0:13804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.561731:0:13804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.561744:0:13804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864821.561804:0:13804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864821.561809:0:13804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864821.561981:0:13804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.562015:0:13804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e000/0x2fcb8c294dc44360 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accf1 expref: 7 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.562037:0:13804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accf1 expref: 6 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864821.562047:0:13804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864821.562067:0:13804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864821.562072:0:13804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e800, rc 0) 00000100:00100000:3.0:1787864821.562799:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:12965:x1874711825983872:12345-192.168.206.36@tcp:101:lsof.0 Request processed in 1370us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864821.562810:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 257 00000100:00100000:1.0:1787864822.041242:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864822.044449:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844895488:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864822.044550:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.045390:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895488 00000100:00100000:0.0:1787864822.045399:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895488 00000100:00100000:0.0:1787864822.045452:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787864822.045462:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844895488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864822.045499:0:7891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864822.045629:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844895488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.045639:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787864822.045750:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844895488:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864822.108880:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864822.553143:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864822.553172:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844895616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864822.553262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864822.553365:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895616 00000100:00100000:0.0:1787864822.553374:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895616 00000100:00100000:0.0:1787864822.553433:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864822.553443:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844895616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864822.553490:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864822.553540:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844895616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864822.553548:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864822.553605:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844895616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864822.554199:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844895744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864822.554262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864822.554777:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895744 00000100:00100000:3.0:1787864822.554784:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895744 00000100:00100000:3.0:1787864822.555996:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787864822.556017:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844895744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864822.556047:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787864822.556602:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844895744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 591us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864822.556612:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787864822.557061:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844895744:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787864823.129454:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864823.389274:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389310:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389341:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389377:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389396:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389412:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389432:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864823.389456:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984512 00000100:00100000:0.0:1787864823.389464:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984512 00000100:00100000:0.0:1787864823.389513:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984384 00000100:00100000:0.0:1787864823.389516:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984384 00000100:00100000:0.0:1787864823.389535:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:0.0:1787864823.389543:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825984512:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864823.389605:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2408:x1874711825984512:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864823.389612:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:0.0:1787864823.389626:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:0.0:1787864823.389632:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825984384:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864823.389682:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825984384:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864823.389689:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:0.0:1787864823.389707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984256 00000100:00100000:0.0:1787864823.389710:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984256 00000100:00100000:0.0:1787864823.389735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984768 00000100:00100000:0.0:1787864823.389750:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984768 00000100:00100000:0.0:1787864823.389774:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984128 00000100:00100000:0.0:1787864823.389777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984128 00000100:00100000:0.0:1787864823.389791:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984640 00000100:00100000:0.0:1787864823.389793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984640 00000100:00100000:0.0:1787864823.389807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 306 00000100:00100000:0.0:1787864823.389813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825984256:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864823.389853:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2408:x1874711825984256:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 40us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864823.389859:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 306 00000100:00100000:0.0:1787864823.389872:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 307 00000100:00100000:0.0:1787864823.389878:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825984768:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864823.390013:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 308 00000100:00100000:2.0:1787864823.390029:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:2408:x1874711825984128:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864823.390062:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:2408:x1874711825984128:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864823.390069:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 308 00000100:00100000:2.0:1787864823.390083:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 309 00000100:00100000:2.0:1787864823.390089:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825984640:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864823.390112:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825984640:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864823.390117:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 309 00000100:00080000:2.0:1787864823.390261:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864823.390265:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864823.390268:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864823.390270:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864823.390444:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825984000 00000100:00100000:3.0:1787864823.390449:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825984000 00000100:00100000:3.0:1787864823.390493:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 387 00000100:00100000:3.0:1787864823.390501:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825984000:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864823.390537:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2408:x1874711825984000:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 37us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864823.390543:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 387 00000100:00100000:0.0:1787864823.391196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825984768:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 1315us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864823.391204:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 307 00000100:00100000:1.0:1787864823.586003:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844895872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864823.587010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864823.587306:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844895872 00000100:00100000:3.0:1787864823.587325:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844895872 00000100:00100000:3.0:1787864823.587378:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787864823.587388:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844895872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864823.587429:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787864823.587507:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844895872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864823.587525:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787864823.589647:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844895872:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1787864824.121633:0:14894:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:07:02 (1787864822) 00010000:00010000:2.0:1787864824.156399:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864825.177818:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864825.369824:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787864825.625380:0:13785:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787864825.625398:0:13785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787864825.625471:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787864825.625478:0:13785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787864826.137089:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844896000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864826.137121:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844896256:0@lo:400:kworker.0 00000100:00100000:1.0:1787864826.137165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137226:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864826.137233:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844896128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137287:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844896768:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864826.137315:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896000 00000100:00100000:0.0:1787864826.137322:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896000 00000100:00100000:3.0:1787864826.137324:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137344:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137360:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787864826.137364:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844896640:0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.137369:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787864826.137378:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844896000:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864826.137384:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844897152:0@lo:400:kworker.0 00002000:00000024:0.0:1787864826.137403:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787864826.137414:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137427:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844897664:0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.137438:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844896000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.137444:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864826.137445:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787864826.137464:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896768 00000100:00100000:3.0:1787864826.137465:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896128 00000100:00100000:3.0:1787864826.137467:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896128 00000100:00100000:0.0:1787864826.137467:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896768 00000100:00100000:3.0:1787864826.137490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787864826.137490:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787864826.137496:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844896128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.137496:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844896768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137530:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844896128:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864826.137530:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844896768:12345-0@lo:400:kworker.0 Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.137537:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1787864826.137537:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787864826.137557:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897280 00000100:00100000:0.0:1787864826.137560:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897280 00000100:00100000:3.0:1787864826.137564:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897152 00000100:00100000:3.0:1787864826.137567:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897152 00000100:00100000:0.0:1787864826.137582:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897664 00000100:00100000:0.0:1787864826.137584:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897664 00000100:00100000:3.0:1787864826.137588:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787864826.137593:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844897280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.137604:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787864826.137609:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844897152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137621:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844897280:12345-0@lo:400:kworker.0 Request processed in 28us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.137640:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787864826.137648:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844897152:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.137651:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787864826.137654:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787864826.137656:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844897664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137681:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844897664:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.137687:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787864826.137720:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844897152:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137730:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1787864826.137734:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9274490c4000, transno 4294967322 00000004:00080000:3.0:1787864826.137744:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:3.0:1787864826.137760:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9274490c6d00, transno 4294967325 00000100:00100000:3.0:1787864826.137764:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844897664:0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.137766:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844896384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864826.137773:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844896768:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137781:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844897280:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137788:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490cb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844896128:0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.137793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864826.137812:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844896896:0@lo:400:kworker.0 00000100:00080000:3.0:1787864826.137823:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787864826.137827:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864826.137832:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896256 00000100:00100000:3.0:1787864826.137841:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896256 00000100:00100000:2.0:1787864826.137846:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844897408:0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.137864:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137870:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896640 00000100:00100000:3.0:1787864826.137873:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896640 00000100:00100000:2.0:1787864826.137879:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787864826.137909:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896896 00000100:00100000:3.0:1787864826.137912:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896896 00000100:00100000:2.0:1787864826.137912:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844896512:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137928:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897408 00000100:00100000:3.0:1787864826.137931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897408 00000100:00100000:3.0:1787864826.137944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787864826.137947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137949:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844896256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.137964:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844897024:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137982:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844896256:12345-0@lo:400:kworker.0 Request processed in 33us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864826.137983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.137988:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787864826.137992:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844897536:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.137997:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897024 00000100:00100000:3.0:1787864826.137999:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897024 00000100:00100000:2.0:1787864826.138010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864826.138012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787864826.138017:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844896640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.138027:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897536 00000100:00100000:2.0:1787864826.138030:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897536 00000100:00100000:3.0:1787864826.138044:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844896640:12345-0@lo:400:kworker.0 Request processed in 26us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864826.138049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787864826.138055:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844896896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.138105:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844896896:12345-0@lo:400:kworker.0 Request processed in 49us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864826.138206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896512 00000100:00100000:0.0:1787864826.138211:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896512 00000100:00100000:0.0:1787864826.138237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787864826.138244:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844896512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864826.138254:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844896000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864826.138269:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1787864826.138279:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844896512:12345-0@lo:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.138285:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787864826.138285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787864826.138292:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.138303:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1787864826.138310:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844897024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.138320:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844897408:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.138326:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1787864826.138334:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844897024:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.138337:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787864826.138340:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1787864826.138342:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.138370:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844897536:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864826.138385:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1787864826.138388:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844896384 00000100:00100000:0.0:1787864826.138392:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844896384 00000100:00080000:3.0:1787864826.138407:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787864826.138411:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864826.138415:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787864826.138427:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844896384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864826.138432:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844896640:0@lo:400:kworker.0 00002000:00000024:0.0:1787864826.138439:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787864826.138444:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844896256:0@lo:400:kworker.0 00000100:00100000:0.0:1787864826.138467:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844896384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864826.138473:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787864826.138486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844896512:0@lo:400:kworker.0 00010000:00080000:3.0:1787864826.138497:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274490ca1c0 x1874711844897024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864826.138506:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490ca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844897024:0@lo:400:kworker.0 00010000:00080000:3.0:1787864826.138515:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274490cbc00 x1874711844897536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864826.138522:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844897536:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.138535:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491b8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844896384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864826.138543:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844896896:0@lo:400:kworker.0 00000100:00100000:3.0:1787864826.138551:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844897408:0@lo:400:kworker.0 00000100:00100000:2.0:1787864826.138797:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:0.0:1787864826.201068:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787864826.654368:0:6490:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787864826.654428:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787864826.654441:0:6542:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787864827.161656:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787864827.161678:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844897792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864827.161743:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864827.161861:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897792 00000100:00100000:0.0:1787864827.161869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897792 00000100:00100000:0.0:1787864827.161935:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787864827.161944:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844897792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864827.161975:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787864827.162031:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844897792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.162038:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787864827.162118:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844897792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787864827.225405:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864827.428632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864827.428998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825985024 00000100:00100000:1.0:1787864827.429008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825985024 00000100:00100000:1.0:1787864827.429076:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:1.0:1787864827.429087:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+19:13189:x1874711825985024:12345-192.168.206.36@tcp:35:umount.0 00000100:00080000:3.0:1787864827.429137:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864827.429316:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+20:13189:x1874711825985024:12345-192.168.206.36@tcp:35:umount.0 Request processed in 230us (714us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787864827.429324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 66 00000100:00100000:2.0:1787864827.431932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864827.432292:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825985280 00000100:00100000:0.0:1787864827.432300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825985280 00000100:00100000:0.0:1787864827.432412:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:0.0:1787864827.432422:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+20:13189:x1874711825985280:12345-192.168.206.36@tcp:35:umount.0 00000100:00100000:0.0:1787864827.432743:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+21:13189:x1874711825985280:12345-192.168.206.36@tcp:35:umount.0 Request processed in 321us (818us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787864827.432751:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 67 00000100:00100000:3.0:1787864827.435371:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864827.435490:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825985536 00000100:00100000:1.0:1787864827.435498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825985536 00000100:00100000:1.0:1787864827.435587:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:1.0:1787864827.435597:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92756dee5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+21:13189:x1874711825985536:12345-192.168.206.36@tcp:35:umount.0 00000100:00100000:1.0:1787864827.435807:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92756dee5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:545fdf19-2645-4c06-a6f5-05dea3348b20+22:13189:x1874711825985536:12345-192.168.206.36@tcp:35:umount.0 Request processed in 211us (443us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787864827.435822:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 68 00000100:00100000:2.0:1787864827.440816:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864827.440951:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825985792 00000100:00100000:0.0:1787864827.440961:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825985792 00000100:00100000:0.0:1787864827.441015:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:0.0:1787864827.441024:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+22:13189:x1874711825985792:12345-192.168.206.36@tcp:35:umount.0 00000100:00100000:0.0:1787864827.442733:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:545fdf19-2645-4c06-a6f5-05dea3348b20+23:13189:x1874711825985792:12345-192.168.206.36@tcp:35:umount.0 Request processed in 1701us (1917us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787864827.442745:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 69 00000100:00100000:2.0:1787864827.446740:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864827.446832:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864827.448248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864827.449945:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825985920 00000100:00100000:0.0:1787864827.449957:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825985920 00000100:00100000:0.0:1787864827.450022:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825986176 00000100:00100000:0.0:1787864827.450026:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825986176 00000100:00100000:0.0:1787864827.450039:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825986048 00000100:00100000:0.0:1787864827.450042:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825986048 00000100:00100000:0.0:1787864827.450060:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:0.0:1787864827.450069:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+15:2407:x1874711825985920:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864827.450082:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864827.450103:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797600/0x2fcb8c294dc432c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac844 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864827.450119:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864827.450178:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+14:2407:x1874711825985920:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 110us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.450198:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:0.0:1787864827.450215:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:0.0:1787864827.450234:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+13:2407:x1874711825986176:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864827.450242:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864827.450251:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31000/0x2fcb8c294dc43591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac91d expref: 13 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864827.450261:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864827.450280:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+12:2407:x1874711825986176:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 58us (3448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.450303:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:0.0:1787864827.450319:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:0.0:1787864827.450325:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2407:x1874711825986048:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864827.450336:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864827.450344:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948200/0x2fcb8c294dc43281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac805 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864827.450353:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864827.450372:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2407:x1874711825986048:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 46us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.450378:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:2.0:1787864827.450698:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864827.450725:0:8426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825986560 00000100:00100000:2.0:1787864827.450729:0:8426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825986560 00000100:00100000:2.0:1787864827.450790:0:8426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 80 00000100:00100000:2.0:1787864827.450797:0:8426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+7:2406:x1874711825986560:12345-192.168.206.36@tcp:9:umount.0 00000020:00000080:2.0:1787864827.450819:0:8426:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc438cb 00000020:00010000:2.0:1787864827.450826:0:8426:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92757fb47800: total 0 00000100:00080000:2.0:1787864827.450830:0:8426:0:(import.c:65:import_set_state_nolock()) ffff92757fb42800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864827.450870:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787864827.451017:0:8426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825986560:12345-192.168.206.36@tcp:9:umount.0 Request processed in 205us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864827.451025:0:8426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 80 00000020:00010000:2.0:1787864827.451043:0:10328:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92757fb47800: total 0 00010000:00010000:2.0:1787864827.451064:0:10328:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92757fb47800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787864827.451105:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc43c8a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb07 expref: 4 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864827.451135:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc44359 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accea expref: 3 pid: 8820 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864827.451149:0:10328:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92757fb47800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787864827.451161:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864827.451163:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864827.451165:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787864827.451173:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787864827.463062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864827.463175:0:8820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825986688 00000100:00100000:1.0:1787864827.463189:0:8820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825986688 00000100:00100000:1.0:1787864827.463265:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 81 00000100:00100000:1.0:1787864827.463274:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825986688:12345-192.168.206.36@tcp:9:umount.0 00000020:00000080:1.0:1787864827.463303:0:8820:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4365c 00000100:00080000:1.0:1787864827.463311:0:8820:0:(import.c:65:import_set_state_nolock()) ffff927448b11800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787864827.463371:0:8820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787864827.463526:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:545fdf19-2645-4c06-a6f5-05dea3348b20+2:2406:x1874711825986688:12345-192.168.206.36@tcp:9:umount.0 Request processed in 253us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864827.463551:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 81 00010000:00010000:3.0:1787864827.463861:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787864827.464010:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864827.471786:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864827.472919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825987712 00000100:00100000:2.0:1787864827.472930:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825987712 00000100:00100000:2.0:1787864827.473041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 258 00000100:00100000:2.0:1787864827.473051:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+23:2406:x1874711825987712:12345-192.168.206.36@tcp:39:umount.0 00000020:00000080:2.0:1787864827.473094:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4328f 00000020:00010000:2.0:1787864827.473110:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff927447ea8000: total 0 00000100:00080000:2.0:1787864827.473114:0:6512:0:(import.c:65:import_set_state_nolock()) ffff927447eae000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864827.473153:0:6512:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1787864827.473312:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:545fdf19-2645-4c06-a6f5-05dea3348b20+22:2406:x1874711825987712:12345-192.168.206.36@tcp:39:umount.0 Request processed in 262us (1532us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787864827.473320:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 258 00000020:00010000:3.0:1787864827.473372:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff927447ea8000: total 0 00010000:00010000:3.0:1787864827.473419:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff927447ea8000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787864827.473448:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864827.473458:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787864827.473467:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387b800/0x2fcb8c294dc4430c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accd5 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473489:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864827.473492:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787864827.473496:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bbe00/0x2fcb8c294dc44344 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acce3 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473509:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864827.473512:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787864827.473515:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797000/0x2fcb8c294dc43632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac947 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473528:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864827.473537:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864827.473551:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f000/0x2fcb8c294dc43ffc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc03 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473566:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864827.473568:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864827.473572:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f800/0x2fcb8c294dc43cf3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb23 expref: 17 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473583:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864827.473585:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864827.473589:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba800/0x2fcb8c294dc43c4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaf2 expref: 16 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473637:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864827.473640:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787864827.473644:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5baa00/0x2fcb8c294dc43c75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb00 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473656:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff927554cab000) 00010000:00010000:3.0:1787864827.473658:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787864827.473661:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030000/0x2fcb8c294dc4392d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aca20 expref: 14 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473677:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927447234300) 00010000:00010000:3.0:1787864827.473679:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864827.473683:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757d948e00/0x2fcb8c294dc435d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac932 expref: 13 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473697:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864827.473699:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864827.473702:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc4423a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acc9d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473712:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff927566faa900) 00010000:00010000:3.0:1787864827.473714:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864827.473718:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba200/0x2fcb8c294dc4432f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accdc expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473731:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff927548d9c800) 00010000:00010000:3.0:1787864827.473734:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787864827.473745:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824f200/0x2fcb8c294dc43d0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acb2a expref: 10 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473762:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff927447c2d200) 00010000:00010000:3.0:1787864827.473764:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864827.473767:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc43b6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acaba expref: 9 pid: 10168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.473780:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9275687e8700) 00010000:00010000:3.0:1787864827.473782:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864827.474670:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757db31a00/0x2fcb8c294dc435bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac92b expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864827.474692:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff927447ea8000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787864827.474716:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864827.474719:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864827.474721:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864827.483686:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864827.483780:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825987840 00000100:00100000:0.0:1787864827.483800:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825987840 00000100:00100000:0.0:1787864827.483877:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 259 00000100:00100000:0.0:1787864827.483918:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+5:2406:x1874711825987840:12345-192.168.206.36@tcp:39:umount.0 00000100:00080000:2.0:1787864827.483942:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1787864827.483950:0:10168:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43296 00000100:00080000:0.0:1787864827.483967:0:10168:0:(import.c:65:import_set_state_nolock()) ffff92744822a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864827.484000:0:10168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787864827.484106:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864827.484152:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:545fdf19-2645-4c06-a6f5-05dea3348b20+3:2406:x1874711825987840:12345-192.168.206.36@tcp:39:umount.0 Request processed in 266us (472us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787864827.484159:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 259 00000100:00100000:3.0:1787864827.673084:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787864827.673109:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844897920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864827.673489:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864827.673502:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844898048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864827.673565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864827.673706:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898048 00000100:00100000:1.0:1787864827.673722:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898048 00000100:00100000:1.0:1787864827.673771:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787864827.673781:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844898048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864827.673809:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864827.673861:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844898048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864827.673868:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787864827.674022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864827.674043:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844898048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864827.676437:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844897920 00000100:00100000:0.0:1787864827.676449:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844897920 00000100:00100000:0.0:1787864827.676516:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787864827.676525:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844897920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864827.676560:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787864827.676764:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844897920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 240us (2743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864827.676772:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787864827.679209:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844897920:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864828.249044:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864828.509658:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864828.509700:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864828.509741:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864828.509870:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988224 00000100:00100000:0.0:1787864828.509879:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988224 00000100:00100000:0.0:1787864828.509976:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988096 00000100:00100000:0.0:1787864828.509980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988096 00000100:00100000:0.0:1787864828.510004:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 316 00000100:00100000:0.0:1787864828.510012:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825988224:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864828.510081:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2408:x1874711825988224:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864828.510088:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 316 00000100:00100000:0.0:1787864828.510105:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 317 00000100:00100000:0.0:1787864828.510111:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825988096:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864828.510133:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2408:x1874711825988096:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864828.510139:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 317 00000100:00100000:2.0:1787864828.510244:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825987968 00000100:00100000:2.0:1787864828.510248:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825987968 00000100:00100000:2.0:1787864828.510285:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 389 00000100:00100000:2.0:1787864828.510292:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825987968:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864828.510316:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825987968:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864828.510322:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 389 00000100:00080000:1.0:1787864828.510436:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864828.510441:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864828.701364:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864828.701396:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844898176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864828.701493:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864828.701727:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898176 00000100:00100000:3.0:1787864828.701736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898176 00000100:00100000:3.0:1787864828.701798:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787864828.701809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844898176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864828.701852:0:6516:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787864828.701972:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844898176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864828.702001:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787864828.702179:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844898176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864829.262850:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864829.263031:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864829.265501:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988480 00000100:00100000:0.0:1787864829.265587:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988480 00000100:00100000:0.0:1787864829.265686:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988352 00000100:00100000:0.0:1787864829.265690:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988352 00000100:00100000:0.0:1787864829.265730:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:0.0:1787864829.265741:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+11:2408:x1874711825988480:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864829.265777:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864829.265803:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc43399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac88a expref: 11 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864829.265824:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864829.265973:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:1.0:1787864829.265985:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576457850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+10:2408:x1874711825988352:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864829.265996:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864829.266007:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824fa00/0x2fcb8c294dc43392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac859 expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864829.266016:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864829.266380:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+9:2408:x1874711825988480:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 638us (3541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864829.266390:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:1.0:1787864829.267853:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576457850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:2408:x1874711825988352:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 1858us (4809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864829.267869:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:3.0:1787864829.268756:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864829.269287:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988608 00000100:00100000:1.0:1787864829.269300:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988608 00000100:00100000:1.0:1787864829.276624:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864829.276658:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+8:2408:x1874711825988608:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864829.276685:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864829.276712:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31200/0x2fcb8c294dc4358a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac916 expref: 8 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864829.276734:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864829.276818:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+7:2408:x1874711825988608:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 179us (8068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864829.276827:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00010000:00010000:0.0:1787864829.280469:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864829.283175:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864829.283266:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988864 00000100:00100000:0.0:1787864829.283278:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988864 00000100:00100000:0.0:1787864829.283364:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 260 00000100:00100000:0.0:1787864829.283375:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+6:2406:x1874711825988864:12345-192.168.206.36@tcp:39:umount.0 00000020:00000080:0.0:1787864829.283427:0:10168:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc433a7 00000020:00010000:0.0:1787864829.283437:0:10168:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92744839c000: total 0 00000100:00080000:0.0:1787864829.283443:0:10168:0:(import.c:65:import_set_state_nolock()) ffff92744839a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864829.283468:0:10168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1787864829.283665:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2406:x1874711825988864:12345-192.168.206.36@tcp:39:umount.0 Request processed in 291us (503us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1787864829.283673:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 260 00000020:00010000:3.0:1787864829.285497:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92744839c000: total 0 00010000:00010000:3.0:1787864829.285590:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92744839c000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787864829.285654:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927549cf1300) 00010000:00010000:3.0:1787864829.285658:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864829.285673:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92744824e800/0x2fcb8c294dc44367 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6accf1 expref: 4 pid: 13804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864829.285702:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92744839c000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787864829.285715:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864829.285718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864829.285719:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864829.296316:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864829.296534:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825988992 00000100:00100000:0.0:1787864829.296546:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825988992 00000100:00100000:0.0:1787864829.296636:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 261 00000100:00100000:0.0:1787864829.296649:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+5:2406:x1874711825988992:12345-192.168.206.36@tcp:39:umount.0 00000020:00000080:0.0:1787864829.296701:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc433ae 00000100:00080000:0.0:1787864829.296713:0:6510:0:(import.c:65:import_set_state_nolock()) ffff92744839d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864829.296747:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:2.0:1787864829.296845:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864829.297002:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d72d3621-0c17-4b0a-8f7a-94eec1706878+3:2406:x1874711825988992:12345-192.168.206.36@tcp:39:umount.0 Request processed in 355us (699us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787864829.297010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 261 00000100:00100000:3.0:1787864829.338208:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864829.338971:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989248 00000100:00100000:0.0:1787864829.338985:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989248 00000100:00100000:0.0:1787864829.339067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 390 00000100:00100000:0.0:1787864829.339080:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+7:2406:x1874711825989248:12345-192.168.206.36@tcp:251:umount.0 00000020:00000080:0.0:1787864829.339137:0:6504:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4326c 00000020:00010000:0.0:1787864829.339146:0:6504:0:(genops.c:1921:obd_stale_export_put()) Put export ffff927447ea9800: total 0 00000100:00080000:0.0:1787864829.339153:0:6504:0:(import.c:65:import_set_state_nolock()) ffff927447eaf000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787864829.340146:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755ed89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bf3a6481-6bff-4a6c-ac5c-f5134d1da809+3:2406:x1874711825989248:12345-192.168.206.36@tcp:251:umount.0 Request processed in 1062us (1955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864829.340159:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 390 00000020:00010000:3.0:1787864829.343466:0:10328:0:(genops.c:1907:obd_stale_export_get()) Get export ffff927447ea9800: total 0 00010000:00010000:3.0:1787864829.343481:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864829.343571:0:10328:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff927447ea9800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787864829.343630:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797400/0x2fcb8c294dc432c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ac84b expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864829.343652:0:10328:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff927447ea9800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787864829.343665:0:10328:0:(genops.c:885:class_export_put()) final put ffff927447ea9800/bf3a6481-6bff-4a6c-ac5c-f5134d1da809 00010000:00010000:3.0:1787864829.343681:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864829.343683:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864829.343685:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787864829.343702:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927447ea9800/bf3a6481-6bff-4a6c-ac5c-f5134d1da809 for MGS 00000020:00000080:1.0:1787864829.343748:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447eaf000 for MGS 00010000:00010000:0.0:1787864830.297087:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864830.994790:0:15090:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787864831.009371:0:15090:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787864831.009429:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.009455:0:15090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.009463:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.009470:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.009492:0:15090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787864831.009498:0:15090:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787864831.009536:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787864831.009540:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787864831.009546:0:15090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787864831.009651:0:15090:0:(import.c:65:import_set_state_nolock()) ffff927549bf4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787864831.009732:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844898304:0@lo:39:umount.0 00010000:00010000:3.0:1787864831.009793:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787864831.009800:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864831.009803:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.009988:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864831.009993:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.010003:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864831.010106:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864831.010113:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787864831.010115:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787864831.010118:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787864831.010143:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.010150:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864831.010178:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.010186:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796c00/0x2fcb8c294dc43322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43329 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.010196:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864831.010198:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864831.010200:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864831.010248:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898304 00000100:00100000:2.0:1787864831.010256:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898304 00000100:00100000:1.0:1787864831.010319:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864831.010358:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864831.010404:0:14659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898432 00000100:00100000:1.0:1787864831.010408:0:14659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898432 00000100:00100000:1.0:1787864831.010451:0:14659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864831.010462:0:14659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+24:3638:x1874711844898432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864831.010475:0:14659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864831.010489:0:14659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30c00/0x2fcb8c294dc43329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43322 expref: 24 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864831.010525:0:14659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864831.010574:0:14659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3638:x1874711844898432:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864831.010582:0:14659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864831.010631:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864831.011018:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787864831.011030:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874711844898304:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787864831.011052:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e83 00000100:00080000:3.0:1787864831.011066:0:6511:0:(import.c:65:import_set_state_nolock()) ffff927547dff000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787864831.011136:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864831.011178:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3636:x1874711844898304:12345-0@lo:39:umount.0 Request processed in 150us (1377us total) trans 0 rc 0/0 00000100:00080000:1.0:1787864831.011190:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927549bf4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787864831.011239:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844898304:0@lo:39:umount.0 00000100:00080000:2.0:1787864831.011279:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787864831.011283:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787864831.011288:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787864831.011572:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1787864831.011583:0:6511:0:(genops.c:885:class_export_put()) final put ffff927547dfa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787864831.012048:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927547dfa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787864831.012131:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927547dff000 for lustre-MDT0000 00010000:00010000:2.0:1787864831.013362:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013379:0:15090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013388:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013407:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013427:0:15090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864831.013433:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013439:0:15090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013445:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013452:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013465:0:15090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787864831.013472:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013477:0:15090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013483:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013489:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013508:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787864831.013512:0:15090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787864831.013516:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013520:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013533:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796e00 already unused, calling callback (ffffffffc13d3c20) 00010000:00010000:2.0:1787864831.013536:0:15090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864831.013539:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.013549:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013554:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864831.013563:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864831.013569:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787864831.013572:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787864831.013609:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013616:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864831.013638:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013645:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796e00/0x2fcb8c294dc43330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43337 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013669:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864831.013673:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013678:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927582173e00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864831.013681:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.013688:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864831.013695:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014313:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864831.014320:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014326:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824fe00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864831.014330:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014337:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864831.014343:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864831.014348:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787864831.014357:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787864831.014360:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787864831.014382:0:15090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014382:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014398:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787864831.014409:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787864831.014409:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864831.014412:0:15090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787864831.014414:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787864831.014417:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787864831.014420:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc4357c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43583 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864831.014421:0:15090:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787864831.014428:0:15090:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787864831.014434:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864831.014438:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.014442:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014444:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755388d200 already unused, calling callback (ffffffffc13d3c20) 00010000:00010000:3.0:1787864831.014447:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1787864831.014447:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014454:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864831.014460:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.014465:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864831.014465:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864831.014467:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787864831.014469:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787864831.014472:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787864831.014473:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927582173e00/0x2fcb8c294dc43226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4322d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787864831.014483:0:15090:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1787864831.014484:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1787864831.014489:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787864831.014495:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864831.014501:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:0.0:1787864831.014503:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1787864831.014510:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92757fa95800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1787864831.014514:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787864831.014518:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92744679f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1787864831.014528:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92755388d200/0x2fcb8c294dc42de2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42de9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787864831.014529:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92757d724000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787864831.014541:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92756de1d800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:0.0:1787864831.014549:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787864831.014551:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff92744839c000 d72d3621-0c17-4b0a-8f7a-94eec1706878 192.168.206.36@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1787864831.014553:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864831.014557:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864831.014586:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864831.014648:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864831.014650:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864831.014656:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864831.014656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864831.014663:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864831.014672:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844898560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864831.014699:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864831.014704:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864831.014707:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864831.014727:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864831.014728:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864831.014733:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844898688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864831.014753:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864831.014759:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898944 00000100:00100000:0.0:1787864831.014776:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898944 00000100:00100000:3.0:1787864831.014777:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898560 00000100:00100000:3.0:1787864831.014779:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898560 00000100:00100000:0.0:1787864831.014807:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898816 00000100:00100000:0.0:1787864831.014810:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898816 00000100:00100000:3.0:1787864831.014816:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844898688 00000100:00100000:3.0:1787864831.014819:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844898688 00000100:00100000:0.0:1787864831.014826:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864831.014834:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+26:3638:x1874711844898944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864831.014845:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864831.014858:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387a000/0x2fcb8c294dc42de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc42de2 expref: 26 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.014870:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864831.014920:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3638:x1874711844898944:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864831.016085:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864831.016098:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+25:3639:x1874711844898560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864831.016110:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787864831.016121:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787864831.016123:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31e00/0x2fcb8c294dc43337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43330 expref: 25 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864831.016134:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864831.016140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864831.016147:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+23:3638:x1874711844898816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864831.016155:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864831.016163:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582173000/0x2fcb8c294dc4322d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43226 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.016172:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864831.016178:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3639:x1874711844898560:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.016193:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+22:3638:x1874711844898816:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864831.016197:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787864831.016200:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787864831.016211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787864831.016217:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+20:3639:x1874711844898688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864831.016224:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864831.016232:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949200/0x2fcb8c294dc43583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc4357c expref: 20 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864831.016240:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864831.016250:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844898560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864831.016258:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f+19:3639:x1874711844898688:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.016264:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787864831.016269:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844898688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864831.016286:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864831.016294:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844898944:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787864831.016465:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff927447ea8000 545fdf19-2645-4c06-a6f5-05dea3348b20 192.168.206.36@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1787864831.016482:0:15090:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92754aaf0000) has exports, disconnecting them 00000020:00080000:2.0:1787864831.016488:0:15090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92757fa95800), last request at 1787864826 00000020:00000080:2.0:1787864831.016494:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43193 00000100:00080000:2.0:1787864831.016507:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92757fa97800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787864831.016565:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787864831.016580:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757fa95800): rc 0 00000020:00000080:0.0:1787864831.016589:0:15090:0:(genops.c:885:class_export_put()) final put ffff92757fa95800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787864831.016650:0:15090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92744679f000), last request at 1787864826 00000020:00000080:0.0:1787864831.016655:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4306d 00000100:00080000:0.0:1787864831.016661:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92744679e000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787864831.016677:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787864831.016686:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92744679f000): rc 0 00000020:00000080:0.0:1787864831.016689:0:15090:0:(genops.c:885:class_export_put()) final put ffff92744679f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787864831.016708:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fa95800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787864831.016744:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757fa97800 for lustre-MDT0000 00000020:00080000:0.0:1787864831.016870:0:15090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92757d724000), last request at 1787864629 00000020:00000080:0.0:1787864831.016874:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f6a 00000100:00080000:0.0:1787864831.016878:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92757d727800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787864831.017356:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787864831.017577:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92744679f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787864831.017641:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744679e000 for lustre-MDT0000 00000020:00080000:0.0:1787864831.017739:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757d724000): rc 0 00000020:00000080:0.0:1787864831.017742:0:15090:0:(genops.c:885:class_export_put()) final put ffff92757d724000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787864831.017748:0:15090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92756de1d800), last request at 1787864629 00000020:00000080:0.0:1787864831.017753:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f2b 00000100:00080000:0.0:1787864831.017758:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92755ed74000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787864831.017868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92757d724000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787864831.017919:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757d727800 for lustre-MDT0000 00010000:00010000:2.0:1787864831.017956:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787864831.017956:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:0.0:1787864831.018072:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92756de1d800): rc 0 00000004:00000080:0.0:1787864831.018077:0:15090:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa20881ac7ae0 00000100:00080000:0.0:1787864831.018094:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787864831.018097:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1787864831.019213:0:15090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787864831.019241:0:15090:0:(import.c:65:import_set_state_nolock()) ffff927566ef9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787864831.019297:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899072:0@lo:39:umount.0 00000100:00100000:1.0:1787864831.019356:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.019506:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899072 00000100:00100000:2.0:1787864831.019512:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899072 00000100:00100000:2.0:1787864831.019592:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787864831.019612:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874711844899072:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787864831.019637:0:7891:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42fc5 00000100:00080000:2.0:1787864831.019644:0:7891:0:(import.c:65:import_set_state_nolock()) ffff92757bde8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864831.019673:0:7891:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1787864831.019805:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3636:x1874711844899072:12345-0@lo:39:umount.0 Request processed in 204us (448us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787864831.019813:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787864831.019935:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787864831.019939:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1787864831.019950:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787864831.020033:0:15090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787864831.020046:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92757fa92000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787864831.020053:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787864831.020067:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1787864831.020075:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787864831.020133:0:15090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787864831.020142:0:15090:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787864831.020212:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92754aaf0000) has no exports 00000100:00100000:0.0:1787864831.020366:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899200:0@lo:9:umount.0 00000100:00100000:0.0:1787864831.020402:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864831.020424:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899328:0@lo:9:umount.0 00000100:00100000:0.0:1787864831.020445:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787864831.020477:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927566ef9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787864831.020483:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899072:0@lo:39:umount.0 00000100:00100000:0.0:1787864831.020587:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899200 00000100:00100000:0.0:1787864831.020593:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899200 00000100:00100000:0.0:1787864831.020639:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899328 00000100:00100000:0.0:1787864831.020643:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899328 00000100:00100000:0.0:1787864831.020663:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787864831.020671:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874711844899200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787864831.020688:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43115 00000100:00080000:0.0:1787864831.020694:0:8423:0:(import.c:65:import_set_state_nolock()) ffff92744679c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864831.020725:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1787864831.020809:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3636:x1874711844899200:12345-0@lo:9:umount.0 Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.020817:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787864831.020831:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787864831.020837:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874711844899328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787864831.020847:0:8423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43257 00000100:00080000:0.0:1787864831.020853:0:8423:0:(import.c:65:import_set_state_nolock()) ffff927447eae800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787864831.020882:0:8423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1787864831.020971:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3636:x1874711844899328:12345-0@lo:9:umount.0 Request processed in 133us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.020977:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1787864831.020994:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864831.021010:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757fa92000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787864831.021018:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787864831.021019:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787864831.021022:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899200:0@lo:9:umount.0 00000100:00080000:0.0:1787864831.021031:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787864831.021034:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787864831.021035:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787864831.021037:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844899328:0@lo:9:umount.0 00000100:00080000:0.0:1787864831.021069:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864831.021073:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787864831.021175:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864831.021186:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787864831.029593:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92754aaf0000) has no exports 00000020:00000080:2.0:1787864831.071143:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e3d 00000020:00000080:2.0:1787864831.071156:0:15090:0:(genops.c:885:class_export_put()) final put ffff92757761f000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787864831.071213:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787864831.071306:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864831.071316:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787864831.071320:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92754aaf4ed8) has no exports 00000020:00000080:0.0:1787864831.071586:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e36 00000020:00000080:0.0:1787864831.071591:0:15090:0:(genops.c:885:class_export_put()) final put ffff9275775c5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787864831.071627:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757761f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787864831.071823:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9275775c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787864831.072002:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864831.072011:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787864831.072014:0:15090:0:(genops.c:885:class_export_put()) final put ffff9275775c7000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787864831.072016:0:15090:0:(genops.c:844:class_export_destroy()) destroying export ffff9275775c7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787864831.072025:0:15090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1787864831.260545:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844899456:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.260562:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844899840:0@lo:400:kworker.0 00000100:00100000:0.0:1787864831.260636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.260642:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864831.260696:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899456 00000100:00100000:1.0:1787864831.260703:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899456 00000100:00100000:3.0:1787864831.260705:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844899584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864831.260739:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787864831.260746:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874711844899456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787864831.260753:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787864831.265835:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757fb6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844899968:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.265836:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844900352:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.265929:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.265965:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787864831.265973:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844899712:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.266011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.266043:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844900224:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.266080:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.266873:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899840 00000100:00100000:2.0:1787864831.266881:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899840 00000100:00100000:2.0:1787864831.267079:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899712 00000100:00100000:2.0:1787864831.267431:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899712 00000100:00100000:2.0:1787864831.267460:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900224 00000100:00100000:2.0:1787864831.267464:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900224 00000100:00100000:2.0:1787864831.267496:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787864831.267506:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844899840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.267579:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844899840:12345-0@lo:400:kworker.0 Request processed in 75us (6945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864831.267586:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1787864831.267616:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787864831.267623:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.267656:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844900224:12345-0@lo:400:kworker.0 Request processed in 34us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864831.267661:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1787864831.267673:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787864831.267677:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874711844899712:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787864831.267683:0:10168:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787864831.267712:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874711844899712:12345-0@lo:400:kworker.0 Request processed in 32us (1699us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787864831.267719:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787864831.267742:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900352 00000100:00100000:0.0:1787864831.267746:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.267748:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900352 00000100:00100000:0.0:1787864831.267791:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844900480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864831.267795:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899968 00000100:00100000:2.0:1787864831.267800:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899968 00000100:00100000:0.0:1787864831.267823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.267830:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787864831.267847:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757e006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844900352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.267884:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757e006050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844900352:12345-0@lo:400:kworker.0 Request processed in 40us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864831.267908:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787864831.268099:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787864831.268109:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844899968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864831.268149:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844899968:12345-0@lo:400:kworker.0 Request processed in 43us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.268155:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787864831.268176:0:10088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900480 00000100:00100000:0.0:1787864831.268180:0:10088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900480 00000100:00100000:0.0:1787864831.268204:0:10088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864831.268211:0:10088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874711844900480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864831.268232:0:10088:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787864831.268263:0:10088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874711844900480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864831.268269:0:10088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787864831.268306:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844899968:0@lo:400:kworker.0 00000100:00100000:0.0:1787864831.268321:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844900480:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787864831.268657:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864831.268662:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864831.268664:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864831.268690:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787864831.268695:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787864831.268699:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787864831.275469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864831.275793:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844900096:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.275793:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844899584 00000100:00100000:2.0:1787864831.275803:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844899584 00000100:00100000:3.0:1787864831.275839:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.277528:0:10168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900096 00000100:00100000:2.0:1787864831.277538:0:10168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900096 00000100:00100000:2.0:1787864831.277607:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787864831.277615:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874711844899584:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787864831.277623:0:10168:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787864831.277688:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874711844899584:12345-0@lo:400:kworker.0 Request processed in 73us (2225us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787864831.277695:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787864831.277713:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787864831.277717:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874711844900096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787864831.277721:0:10168:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787864831.277744:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1874711844900096:12345-0@lo:400:kworker.0 Request processed in 26us (1906us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787864831.277750:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:2.0:1787864831.277819:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787864831.277824:0:3640:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787864831.277828:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787864831.277833:0:3640:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864831.277837:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 191 00000100:00080000:2.0:1787864831.277844:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff927447eba800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864831.277905:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927446fa5680 x1874711844900608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787864831.281115:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3640:1874711844900096:0@lo:400:kworker.0 00000100:00080000:2.0:1787864831.281177:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787864831.281181:0:3640:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787864831.281185:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787864831.281190:0:3640:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864831.281193:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 154 00000100:00080000:2.0:1787864831.281201:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92757d720000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864831.281244:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927446fa4f00 x1874711844900736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787864831.281257:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874711844899584:0@lo:400:kworker.0 00000100:00100000:2.0:1787864831.281319:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844900608:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787864831.281374:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.281415:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844900736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787864831.281450:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864831.281486:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900608 00000100:00100000:2.0:1787864831.281491:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900608 00000100:00100000:2.0:1787864831.281519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900736 00000100:00100000:2.0:1787864831.281522:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900736 00000100:00100000:2.0:1787864831.281633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787864831.281641:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874711844899456:12345-0@lo:400:kworker.0 Request processed in 20707us (20821us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787864831.281645:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844900608:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1787864831.281656:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00010000:02000000:2.0:1787864831.281666:0:6511:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1787864831.281695:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787864831.281698:0:3639:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787864831.281701:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787864831.281705:0:3639:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864831.281709:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 154 00000100:00080000:1.0:1787864831.281713:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92755ed70800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864831.281729:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbb8b40 x1874711844900864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864831.281747:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844899456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864831.281766:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844900864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787864831.281864:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864831.282059:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900864 00000100:00100000:1.0:1787864831.282063:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900864 00000100:00100000:1.0:1787864831.282085:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787864831.282090:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844900864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787864831.282098:0:7891:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787864831.282135:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844900864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (271us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864831.282142:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:1.0:1787864831.282385:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864831.282390:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787864831.282393:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844900864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787864831.282452:0:10168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787864831.282457:0:10168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1874711844900736:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787864831.282466:0:10168:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787864831.282495:0:10168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3636:x1874711844900736:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 37us (1045us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864831.282501:0:10168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1787864831.282526:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864831.282530:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787864831.282533:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844900736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1787864831.307919:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844900608:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26266us (26536us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787864831.307948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1787864831.308018:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864831.308025:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787864831.308031:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844900608:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787864831.315388:0:3638:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864831.315401:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 172 00000100:00080000:0.0:1787864831.315427:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92757da99000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864831.319876:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbb8b40 x1874711844900992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787864831.319972:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844900992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787864831.320038:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864831.320149:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844900992 00000100:00100000:0.0:1787864831.320157:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844900992 00000100:00100000:0.0:1787864831.320208:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787864831.320215:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874711844900992:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1787864831.320232:0:8448:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787864831.320289:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3638:1874711844899712:0@lo:400:kworker.0 00010000:00080000:1.0:1787864831.320319:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9274490c6d00 x1874711844900224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864831.320331:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844900224:0@lo:400:kworker.0 00010000:00080000:1.0:1787864831.320343:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757fb6b480 x1874711844899840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864831.320352:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757fb6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844899840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864831.320364:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844900352:0@lo:400:kworker.0 00000100:00100000:0.0:1787864831.320536:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874711844900992:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 319us (496us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787864831.320544:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1787864831.320683:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864831.320689:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864831.320692:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844900992:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1787864831.321205:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864832.345329:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787864832.797811:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787864832.797821:0:8419:0:(genops.c:885:class_export_put()) final put ffff927446799000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787864832.797848:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:0.0:1787864832.797851:0:8419:0:(genops.c:885:class_export_put()) final put ffff927448b15000/545fdf19-2645-4c06-a6f5-05dea3348b20 00000100:00100000:1.0:1787864832.798459:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787864832.798479:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844901120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864832.798552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864832.798630:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901120 00000100:00100000:1.0:1787864832.798638:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901120 00000100:00100000:1.0:1787864832.798680:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787864832.798687:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844901120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864832.798715:0:8428:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787864832.798766:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844901120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864832.798773:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787864832.798812:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844901120:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1787864832.799365:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927446799000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787864832.799413:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927448b15000/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-OST0000 00000020:00000080:3.0:1787864832.799430:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744679c800 for lustre-OST0000 00000020:00000080:3.0:1787864832.799434:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927448b11800 for lustre-OST0000 00000001:00100000:0.0:1787864832.799519:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787864832.799528:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1787864832.799532:0:7441:0:(genops.c:885:class_export_put()) final put ffff92757da1e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787864832.799548:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00080000:0.0:1787864832.799553:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1787864832.799555:0:7441:0:(genops.c:885:class_export_put()) final put ffff92744839a800/d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00100000:0.0:1787864832.799560:0:7441:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000001:00080000:0.0:1787864832.799563:0:7441:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1787864832.799565:0:7441:0:(genops.c:885:class_export_put()) final put ffff927448228000/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:3.0:1787864832.800152:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da1e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1787864832.800186:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92744839a800/d72d3621-0c17-4b0a-8f7a-94eec1706878 for lustre-MDT0001 00000020:00000080:3.0:1787864832.800217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927448228000/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-MDT0001 00000020:00000080:3.0:1787864832.800245:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757bde8000 for lustre-MDT0001 00000020:00000080:3.0:1787864832.800249:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744839d000 for lustre-MDT0001 00000020:00000080:3.0:1787864832.800253:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744822a800 for lustre-MDT0001 00000001:00100000:2.0:1787864832.802036:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787864832.802044:0:9504:0:(genops.c:885:class_export_put()) final put ffff927447eab800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787864832.802063:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:2.0:1787864832.802066:0:9504:0:(genops.c:885:class_export_put()) final put ffff92757fb47800/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:1.0:1787864832.803282:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787864832.807262:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fb47800/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-OST0001 00000001:00100000:3.0:1787864832.807422:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787864832.807428:0:6490:0:(genops.c:885:class_export_put()) final put ffff92756de1d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787864832.807483:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447eae800 for lustre-OST0001 00000020:00000080:1.0:1787864832.807490:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757fb42800 for lustre-OST0001 00000001:00100000:3.0:1787864832.807575:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d72d3621-0c17-4b0a-8f7a-94eec1706878 00000001:00080000:3.0:1787864832.807583:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1787864832.807586:0:6490:0:(genops.c:885:class_export_put()) final put ffff92744839c000/d72d3621-0c17-4b0a-8f7a-94eec1706878 00000020:00000080:1.0:1787864832.807620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92756de1d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787864832.807690:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92755ed74000 for lustre-MDT0000 00000001:00100000:3.0:1787864832.807730:0:6490:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 545fdf19-2645-4c06-a6f5-05dea3348b20 00000001:00080000:3.0:1787864832.807735:0:6490:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787864832.807742:0:6490:0:(genops.c:885:class_export_put()) final put ffff927447ea8000/545fdf19-2645-4c06-a6f5-05dea3348b20 00000020:00000080:1.0:1787864832.807786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff92744839c000/d72d3621-0c17-4b0a-8f7a-94eec1706878 for lustre-MDT0000 00000020:00000080:1.0:1787864832.807820:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927447ea8000/545fdf19-2645-4c06-a6f5-05dea3348b20 for lustre-MDT0000 00000020:00000080:1.0:1787864832.807854:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744839a000 for lustre-MDT0000 00000020:00000080:1.0:1787864832.807858:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447eae000 for lustre-MDT0000 00000020:01000000:0.0:1787864833.113015:0:15090:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927447e0b9c0 - data ffff927572f51438/ffff92757dcdd800 00000020:01000000:0.0:1787864833.113171:0:15090:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927577709480 - data ffff927572d74360/ffff9275774ac400 00000001:00000004:0.0:1787864833.119381:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1787864833.166969:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787864833.166977:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787864833.166991:0:15090:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff92757dc14b40 x1874711844899072/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787864841 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864833.167032:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787864833.169349:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787864833.169455:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1787864833.169473:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864833.169475:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787864833.169765:0:8818:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787864833.169770:0:8818:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1787864833.169783:0:8818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787864833.170492:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787864833.170496:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1787864833.170513:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864833.170515:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787864833.170856:0:9928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787864833.170859:0:9928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1787864833.170877:0:9928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787864833.172871:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e05 00000020:00000080:1.0:1787864833.172882:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754ab04000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787864833.173833:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab04000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787864833.175232:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e1a 00000020:00000080:1.0:1787864833.175242:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754ab00000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787864833.175289:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787864833.175294:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.175301:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787864833.175304:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92754aaf3490) has no exports 00000004:01000000:1.0:1787864833.175467:0:15090:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787864833.175475:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43250 00000020:00000080:1.0:1787864833.175479:0:15090:0:(genops.c:885:class_export_put()) final put ffff9274481d4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.176178:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab00000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787864833.176282:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787864833.176287:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.176298:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787864833.176301:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff927448291a48) has no exports 00000020:00000080:1.0:1787864833.176308:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43249 00000020:00000080:1.0:1787864833.176313:0:15090:0:(genops.c:885:class_export_put()) final put ffff92744822c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787864833.176422:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9274481d4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787864833.176430:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92744822c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787864833.176997:0:15090:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787864833.177001:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787864833.177005:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1787864833.177011:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864833.177013:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864833.177095:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.177105:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787864833.177111:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4310e 00000020:00000080:1.0:1787864833.177116:0:15090:0:(genops.c:885:class_export_put()) final put ffff927446e06000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.177425:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927448229000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787864833.177437:0:38:0:(genops.c:885:class_export_put()) final put ffff9274481d2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.177439:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9274481d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787864833.177444:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787864833.177607:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787864833.177611:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.177617:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787864833.177620:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff927446ff3490) has no exports 00000020:00000080:1.0:1787864833.177625:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43107 00000020:00000080:1.0:1787864833.177629:0:15090:0:(genops.c:885:class_export_put()) final put ffff92757fa92800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787864833.177825:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927446e06000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787864833.177831:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fa92800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787864833.178106:0:15090:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787864833.178109:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787864833.178111:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1787864833.178115:0:15090:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864833.178117:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864833.178178:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.178185:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787864833.178195:0:15090:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787864833.178201:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42fbe 00000020:00000080:1.0:1787864833.178205:0:15090:0:(genops.c:885:class_export_put()) final put ffff92757da1a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.178546:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757fa92000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787864833.178552:0:38:0:(genops.c:885:class_export_put()) final put ffff92757de4e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.178554:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757de4e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787864833.178558:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787864833.178698:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787864833.178702:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.178708:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787864833.178710:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92757bc33490) has no exports 00000020:00000080:1.0:1787864833.178715:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42fb7 00000020:00000080:1.0:1787864833.178718:0:15090:0:(genops.c:885:class_export_put()) final put ffff927566eff000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787864833.179434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da1a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787864833.179442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff927566eff000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787864833.200696:0:15090:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787864833.200704:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787864833.200708:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787864833.200715:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864833.200768:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.200780:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787864833.200815:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.200818:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787864833.200823:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754b00c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787864833.200827:0:15090:0:(genops.c:844:class_export_destroy()) destroying export ffff92754b00c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787864833.201166:0:15090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787864833.201228:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927566ef9000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1787864833.201236:0:38:0:(genops.c:885:class_export_put()) final put ffff92757d723800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787864833.201238:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757d723800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1787864833.201246:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787864833.201332:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e21 00000020:00000080:1.0:1787864833.201338:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754ab03000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787864833.201346:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787864833.201350:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.201355:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787864833.201359:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92754aaf1a48) has no exports 00000020:00000080:1.0:1787864833.201387:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.201392:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787864833.201396:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e28 00000020:00000080:1.0:1787864833.201400:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754ab01000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787864833.201409:0:15090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927548600000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787864833.201411:0:15090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927548600000 3 00000020:01000004:1.0:1787864833.201415:0:15090:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff927548600000 from lustre-MDT0000 00000020:00000080:1.0:1787864833.201433:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864833.201437:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787864833.201439:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754ab02000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787864833.201441:0:15090:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab02000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787864833.201447:0:15090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787864833.201475:0:15090:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787864833.201479:0:15090:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787864833.201482:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787864833.201484:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864833.201487:0:15090:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787864833.201493:0:15090:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92754be0e000 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787864833.201498:0:15090:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff92755ed99a48) has exports, disconnecting them 00000020:00080000:1.0:1787864833.201502:0:15090:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92754be0e000), last request at 1787864610 00000020:00000080:1.0:1787864833.201515:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42dc6 00000020:00010000:1.0:1787864833.201524:0:15090:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92754be0e000: total 2 00000100:00080000:1.0:1787864833.201528:0:15090:0:(import.c:65:import_set_state_nolock()) ffff92754be0a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787864833.201541:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92754be0e000): rc 0 00000020:00080000:1.0:1787864833.201545:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff92755ed99a48) has no exports 00000100:00100000:2.0:1787864833.201681:0:6503:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff927576421e00:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1787864833.201752:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff92754901a000:6505] 2 exiting: rc = 0 00000100:00100000:1.0:1787864833.201825:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff927576420a00:6504] 1 exiting: rc = 0 00000020:00010000:2.0:1787864833.201837:0:10329:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92754be0e000: total 2 00010000:00010000:2.0:1787864833.201877:0:10329:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92754be0e000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787864833.201923:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927582172200/0x2fcb8c294dc42ec2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc42ebb expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.201941:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824f600/0x2fcb8c294dc432ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc432f8 expref: 13 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.201951:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797800/0x2fcb8c294dc4330d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43306 expref: 12 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.201976:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446796800/0x2fcb8c294dc4331b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43314 expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.201988:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755388c000/0x2fcb8c294dc42ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc42ec9 expref: 10 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202000:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797200/0x2fcb8c294dc43559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43552 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202009:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30000/0x2fcb8c294dc43567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc43560 expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202019:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927446797c00/0x2fcb8c294dc43575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc4356e expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202030:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948600/0x2fcb8c294dc43345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc4333e expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202038:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948800/0x2fcb8c294dc432d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc432ce expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202048:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948000/0x2fcb8c294dc431e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc431e0 expref: 4 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202058:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db30e00/0x2fcb8c294dc432f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc432ea expref: 3 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202067:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757db31c00/0x2fcb8c294dc432e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2fcb8c294dc432dc expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864833.202086:0:10329:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92754be0e000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787864833.202098:0:10329:0:(genops.c:885:class_export_put()) final put ffff92754be0e000/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f 00010000:00010000:2.0:1787864833.202106:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864833.202108:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864833.202110:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787864833.202190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab03000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787864833.202195:0:38:0:(genops.c:885:class_export_put()) final put ffff92754ab06800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787864833.202196:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab06800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787864833.202200:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787864833.202225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab01000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787864833.202229:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92754be0e000/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f for MGS 00000020:00000080:3.0:1787864833.202254:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92754be0a000 for MGS 00000100:00100000:3.0:1787864833.202429:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202436:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202442:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202447:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202452:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202459:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202472:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202477:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202484:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202489:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202494:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202499:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202504:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202510:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202516:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202523:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202540:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202546:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202551:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202556:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202563:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202568:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202573:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202578:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202583:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202598:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202604:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202610:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202615:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202620:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202625:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202631:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202636:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202641:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202646:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202652:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202658:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202662:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202667:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202673:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202678:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202690:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202695:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202701:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202706:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202712:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202718:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202724:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202730:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202735:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202740:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202745:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202750:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202879:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202906:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202914:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202922:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202928:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202933:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202939:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202944:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202950:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202955:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864833.202960:0:15090:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787864833.204228:0:15090:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927447e0b720 - data ffff927572f51e58/ffff927447e4dc00 00000020:01000000:3.0:1787864833.204427:0:15090:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff92754b9b8d80 - data ffff92754aeb3ca8/ffff9275764b8800 00000020:00000080:3.0:1787864833.205379:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42daa 00000020:00000080:3.0:1787864833.205388:0:15090:0:(genops.c:885:class_export_put()) final put ffff927542c34800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787864833.205407:0:15090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927548600000 from MGS, refs=2 00000020:01000004:3.0:1787864833.205410:0:15090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927548600000 2 00000020:01000004:3.0:1787864833.205413:0:15090:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff927548600000 from MGS 00000020:00000080:3.0:1787864833.205434:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787864833.205440:0:15090:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787864833.205442:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754b9c2800/MGS 00000020:00000080:3.0:1787864833.205445:0:15090:0:(genops.c:844:class_export_destroy()) destroying export ffff92754b9c2800/MGS for MGS 00000020:01000000:3.0:1787864833.205450:0:15090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787864833.205523:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787864833.205537:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787864833.205542:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787864833.205547:0:15090:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff927549bf1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787864833.205553:0:15090:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff92755ef81a48) has exports, disconnecting them 00000020:00080000:3.0:1787864833.205557:0:15090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff927549bf1000), last request at 1787864610 00000020:00000080:3.0:1787864833.205561:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e75 00000020:00080000:3.0:1787864833.205571:0:15090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff927549bf1000): rc 0 00000020:00000080:3.0:1787864833.205575:0:15090:0:(genops.c:885:class_export_put()) final put ffff927549bf1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787864833.206413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927542c34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787864833.206422:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787864833.209115:0:15090:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787864833.209123:0:15090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787864833.209128:0:15090:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787864833.209134:0:15090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787864833.209299:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864833.209308:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787864833.209314:0:15090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927548600000 1 00000020:00000080:2.0:1787864833.209321:0:15090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42d9c 00000020:00000080:2.0:1787864833.209329:0:15090:0:(genops.c:885:class_export_put()) final put ffff927554cd0800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787864833.209335:0:15090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787864833.209339:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864833.209343:0:15090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787864833.209347:0:15090:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff92755ef80000) has no exports 00000020:00000080:1.0:1787864833.210022:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927549bf4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787864833.210031:0:36:0:(genops.c:885:class_export_put()) final put ffff927549bf5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787864833.210035:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787864833.210040:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787864833.210108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff927554cd0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787864833.298748:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864833.298768:0:15090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787864833.298772:0:15090:0:(genops.c:885:class_export_put()) final put ffff92754b9c6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787864833.298777:0:15090:0:(genops.c:844:class_export_destroy()) destroying export ffff92754b9c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787864833.298788:0:15090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787864833.303379:0:15090:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff927545702000 00000020:02000400:3.0:1787864833.303454:0:15090:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787864833.369184:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864834.393821:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864835.417031:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787864835.620513:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1787864836.378605:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787864836.378614:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787864836.378618:0:36:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864836.378628:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1787864836.378635:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864836.378642:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92755ed70800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864836.378673:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbb92c0 x1874711844901376/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864836.378690:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787864836.378694:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787864836.378696:0:36:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864836.378699:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1787864836.378702:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864836.378705:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92757d720000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864836.379195:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbba1c0 x1874711844901504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864836.379210:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787864836.379213:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787864836.379215:0:36:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864836.379219:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1787864836.379222:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864836.379226:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92757da99000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864836.379241:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbb9680 x1874711844901632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864836.379272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787864836.379276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787864836.379278:0:36:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864836.379281:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 356 00000100:00080000:1.0:1787864836.379284:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864836.379287:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff927447eba800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864836.379297:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbba940 x1874711844902016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864836.379348:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844901760:0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.379428:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864836.379501:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787864836.379507:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844901248:0@lo:400:kworker.0 00000100:00100000:2.0:1787864836.379658:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844901376:0@lo:38:kworker.0 00000100:00100000:2.0:1787864836.379693:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.379716:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844901504:0@lo:38:kworker.0 00000100:00100000:2.0:1787864836.379734:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.379760:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844901632:0@lo:38:kworker.0 00000100:00100000:2.0:1787864836.379778:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.379806:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844902016:0@lo:38:kworker.0 00000100:00100000:2.0:1787864836.379828:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.379878:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844902144:0@lo:400:kworker.0 00000100:00100000:2.0:1787864836.379919:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.379939:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787864836.379945:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844901888:0@lo:400:kworker.0 00000100:00100000:2.0:1787864836.379971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.380005:0:7891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901376 00000100:00100000:2.0:1787864836.380013:0:7891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901376 00000100:00100000:2.0:1787864836.380057:0:7891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787864836.380065:0:7891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844901376:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787864836.380247:0:7891:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787864836.380293:0:7891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844901376:12345-0@lo:38:kworker.0 Request processed in 227us (598us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787864836.380302:0:7891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787864836.380329:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901760 00000100:00100000:2.0:1787864836.380333:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901760 00000100:00100000:2.0:1787864836.380376:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901504 00000100:00100000:2.0:1787864836.380379:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901504 00000100:00100000:2.0:1787864836.380386:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901632 00000100:00100000:2.0:1787864836.380388:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901632 00000100:00100000:2.0:1787864836.380395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902016 00000100:00100000:2.0:1787864836.380397:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902016 00000100:00100000:2.0:1787864836.380405:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902144 00000100:00100000:2.0:1787864836.380407:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902144 00000100:00100000:2.0:1787864836.380422:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787864836.380428:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864836.380466:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844901760:12345-0@lo:400:kworker.0 Request processed in 38us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.380480:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1787864836.380493:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787864836.380498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844902144:12345-0@lo:400:kworker.0 00000400:00000100:1.0:1787864836.381195:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874711844901248 offset 0 length 224: 4 00000100:00100000:1.0:1787864836.381235:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844902272:0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.381282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787864836.381330:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff92757dbb9a40 x1874711844901760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864836.381346:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844901760:0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.381400:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787864836.381407:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844901504:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787864836.381425:0:6512:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787864836.381461:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844901504:12345-0@lo:38:kworker.0 Request processed in 53us (1724us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864836.381468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787864836.381500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787864836.381506:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844901632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787864836.381515:0:6512:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787864836.385378:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844901888 00000100:00100000:0.0:1787864836.385397:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844901888 00000100:00100000:0.0:1787864836.385471:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902272 00000100:00100000:0.0:1787864836.385475:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902272 00000100:00100000:0.0:1787864836.385509:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787864836.385532:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844901888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864836.386271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874711844902144:12345-0@lo:400:kworker.0 Request processed in 5764us (6342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.386285:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1787864836.386339:0:13804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787864836.386346:0:13804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3636:x1874711844902016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787864836.386377:0:13804:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787864836.387176:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844901632:12345-0@lo:38:kworker.0 Request processed in 5662us (7390us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864836.387188:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787864836.387237:0:13804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3636:x1874711844902016:12345-0@lo:38:kworker.0 Request processed in 889us (7406us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864836.387243:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844902400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864836.387250:0:13804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787864836.387302:0:8820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787864836.387304:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.387319:0:8820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844902272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.387369:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902400 00000100:00100000:1.0:1787864836.387377:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902400 00000100:00100000:2.0:1787864836.387382:0:8820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844902272:12345-0@lo:400:kworker.0 Request processed in 69us (6097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.387390:0:8820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787864836.387421:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1787864836.387425:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864836.387431:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844902400:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787864836.387434:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864836.387441:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:1.0:1787864836.387458:0:8427:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787864836.387495:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844902400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.387509:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:2.0:1787864836.387522:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff92757dbbbc00 x1874711844902144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864836.387540:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844902144:0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.387554:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844902400:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787864836.387610:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1787864836.387706:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844902272:0@lo:400:kworker.0 00000100:00080000:2.0:1787864836.389246:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864836.389255:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844901376:0@lo:38:kworker.0 00000100:00080000:2.0:1787864836.389296:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864836.389300:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864836.389303:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844901504:0@lo:38:kworker.0 00000100:00080000:2.0:1787864836.389317:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864836.389321:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864836.389324:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844901632:0@lo:38:kworker.0 00000100:00080000:2.0:1787864836.389336:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864836.389340:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864836.389344:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844902016:0@lo:38:kworker.0 00000100:00100000:1.0:1787864836.393915:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844901888:12345-0@lo:400:kworker.0 Request processed in 8363us (13907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864836.393935:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787864836.396801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844901888:0@lo:400:kworker.0 00010000:00010000:2.0:1787864836.443714:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787864836.719432:0:15291:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787864836.743331:0:15291:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1787864836.743408:0:15291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.743426:0:15291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.743435:0:15291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.743443:0:15291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.743512:0:15291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787864836.743518:0:15291:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787864836.743552:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787864836.743557:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787864836.743563:0:15291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787864836.743583:0:15291:0:(import.c:65:import_set_state_nolock()) ffff92757d720000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1787864836.743589:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787864836.743609:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787864836.743613:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787864836.744778:0:15291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.744797:0:15291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.744805:0:15291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.744812:0:15291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.745459:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864836.745469:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.745478:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db31600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864836.745482:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.745492:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864836.745499:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864836.745505:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787864836.745507:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787864836.745511:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787864836.745556:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.745591:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787864836.745681:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844902528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864836.745801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.745935:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902528 00000100:00100000:2.0:1787864836.745944:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902528 00000100:00100000:2.0:1787864836.746005:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787864836.746014:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576455c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874711844902528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787864836.746021:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787864836 with bad export cookie 3444000449081126342 00010000:00010000:1.0:1787864836.746983:0:15291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787864836.747035:0:15291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747047:0:15291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747055:0:15291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747063:0:15291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747082:0:15291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787864836.747088:0:15291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747114:0:15291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747121:0:15291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747127:0:15291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747141:0:15291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787864836.747147:0:15291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747340:0:15291:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747348:0:15291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747354:0:15291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864836.747375:0:15291:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1787864836.747379:0:15291:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1787864836.747467:0:15291:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1787864836.747472:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1787864836.747478:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864836.747495:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787864836.747503:0:15291:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff92757fa97000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787864836.747550:0:15291:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff92744679a000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787864836.747556:0:15291:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff927566f7b490) has exports, disconnecting them 00000020:00080000:1.0:1787864836.747562:0:15291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff92757fa97000), last request at 1787864836 00000020:00000080:1.0:1787864836.747591:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc431a8 00000100:00080000:1.0:1787864836.747625:0:15291:0:(import.c:65:import_set_state_nolock()) ffff92757fa90000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787864836.747722:0:15291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757fa97000): rc 0 00000020:00000080:1.0:1787864836.747738:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757fa97000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1787864836.747754:0:15291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff92744679a000), last request at 1787864836 00000020:00000080:1.0:1787864836.747758:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43082 00000100:00080000:1.0:1787864836.747779:0:15291:0:(import.c:65:import_set_state_nolock()) ffff92744679a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787864836.747787:0:15291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92744679a000): rc 0 00000020:00000080:1.0:1787864836.747789:0:15291:0:(genops.c:885:class_export_put()) final put ffff92744679a000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1787864836.747797:0:15291:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa20881c4fae0 00000100:00080000:1.0:1787864836.747821:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787864836.747825:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1787864836.747922:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.747932:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db31600/0x2fcb8c294dc43306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4330d expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.747949:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787864836.747954:0:10328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.747960:0:10328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864836.747964:0:10328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748381:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864836.748389:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748409:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864836.748413:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748424:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864836.748446:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864836.748453:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787864836.748456:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787864836.748459:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787864836.748582:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748590:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864836.748622:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748642:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796000/0x2fcb8c294dc431e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc431e7 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748658:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864836.748676:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748682:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864836.748685:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748703:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864836.748709:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864836.748715:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787864836.748718:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787864836.748730:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787864836.748746:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.748838:0:10328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864836.748855:0:10328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864836.748860:0:10328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787864836.748862:0:10328:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787864836.748864:0:10328:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787864836.748881:0:10328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.748918:0:10328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864836.748922:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864836.748936:0:10328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748936:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748950:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949a00/0x2fcb8c294dc4356e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc43575 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.748953:0:10328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796400/0x2fcb8c294dc43314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc4331b expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748960:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864836.748961:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864836.748962:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864836.748964:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864836.748965:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864836.748970:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864836.748973:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.748980:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864836.748986:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864836.748991:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787864836.748993:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787864836.748995:0:6500:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787864836.749011:0:6500:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.749017:0:6500:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864836.749023:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.749029:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031c00/0x2fcb8c294dc42ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2fcb8c294dc42ed0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864836.749053:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864836.749055:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864836.749056:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864836.749102:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844902784:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787864836.749220:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fa97000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1787864836.749274:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92744679a000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1787864836.749299:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757fa90000 for lustre-MDT0001 00000020:00000080:3.0:1787864836.749305:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744679a800 for lustre-MDT0001 00000100:00100000:0.0:1787864836.749332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.749399:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787864836.749407:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844902912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864836.749430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864836.749460:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902784 00000100:00100000:0.0:1787864836.749468:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902784 00000100:00100000:0.0:1787864836.749498:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844902912 00000100:00100000:0.0:1787864836.749501:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844902912 00000100:00100000:0.0:1787864836.749516:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864836.749524:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874711844902784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787864836.749532:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787864836 with bad export cookie 3444000449081126342 00000100:00100000:0.0:1787864836.749591:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874711844902784:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (258us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787864836.749600:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787864836.749618:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787864836.749622:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874711844902912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787864836.749626:0:6496:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787864836 with bad export cookie 3444000449081126342 00000100:00100000:0.0:1787864836.749653:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3638:x1874711844902912:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (221us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787864836.749659:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787864836.749692:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.136@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787864836.749697:0:3638:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787864836.749710:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.136@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787864836.750186:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864836.750194:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787864836.751997:0:15291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787864836.752008:0:15291:0:(import.c:65:import_set_state_nolock()) ffff92755ed70800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1787864836.759276:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576455c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874711844902528:12345-0@lo:103:ldlm_bl.0 Request processed in 13254us (13466us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787864836.759292:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787864836.760351:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787864836.760370:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1787864836.760396:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787864836.760461:0:15291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787864836.760512:0:15291:0:(import.c:65:import_set_state_nolock()) ffff92757de4c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787864836.760533:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787864836.760536:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1787864836.760546:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787864836.760646:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844903168:0@lo:9:umount.0 00000100:00100000:2.0:1787864836.760719:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864836.761263:0:8425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844903168 00000100:00100000:2.0:1787864836.761273:0:8425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844903168 00000100:00100000:2.0:1787864836.761333:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864836.761343:0:8425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874711844903168:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787864836.761437:0:8425:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc430cf 00000100:00080000:2.0:1787864836.761450:0:8425:0:(import.c:65:import_set_state_nolock()) ffff92744679d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864836.761505:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787864836.761702:0:8425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3636:x1874711844903168:12345-0@lo:9:umount.0 Request processed in 359us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.761710:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1787864836.762198:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757de4c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787864836.762207:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787864836.762209:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787864836.762214:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844903168:0@lo:9:umount.0 00000100:00080000:2.0:1787864836.762247:0:15291:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787864836.762269:0:15291:0:(import.c:65:import_set_state_nolock()) ffff9274481d5800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787864836.762295:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844903296:0@lo:9:umount.0 00000100:00100000:2.0:1787864836.762338:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787864836.762514:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff927566f7b490) has no exports 00010000:00010000:2.0:1787864836.762790:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864836.762868:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844903296 00000100:00100000:2.0:1787864836.762885:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844903296 00000100:00100000:2.0:1787864836.763042:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787864836.763053:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3636:x1874711844903296:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787864836.763088:0:14166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43211 00000100:00080000:2.0:1787864836.763098:0:14166:0:(import.c:65:import_set_state_nolock()) ffff927447ea9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787864836.763139:0:14166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1787864836.763279:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3636:x1874711844903296:12345-0@lo:9:umount.0 Request processed in 228us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864836.763287:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787864836.763331:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9274481d5800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787864836.763336:0:3636:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787864836.763338:0:3636:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787864836.763342:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844903296:0@lo:9:umount.0 00010000:00010000:2.0:1787864836.763441:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864836.794535:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.136@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787864836.794540:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787864836.794550:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dbbb480 x1874711844901248/t0(0) o400->MGC192.168.206.136@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864836.794562:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff927448bfd680 x1874711844902528/t0(0) o103->MGC192.168.206.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864836.794582:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dc143c0 x1874711844902784/t0(0) o103->MGC192.168.206.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864836.794592:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff927448bfcf00 x1874711844902912/t0(0) o103->MGC192.168.206.136@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787864852 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787864836.794661:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787864836.794664:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787864836.794666:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787864836.794712:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:0:1874711844903040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864836.794931:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3639:1874711844902528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864836.796054:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:0:1874711844902656:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787864836.797060:0:3638:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864836.797072:0:3638:0:(import.c:510:import_select_connection()) MGC192.168.206.136@tcp: connect to NID 0@lo last attempt 135 00000100:00080000:0.0:1787864836.797080:0:3638:0:(import.c:624:import_select_connection()) MGC192.168.206.136@tcp: import ffff927573276800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864836.797182:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc16d00 x1874711844903424/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864836.797228:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844902784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864836.797238:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844901248:0@lo:400:kworker.0 00000100:00100000:1.0:1787864836.797258:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844903424:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:0.0:1787864836.797273:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3638:1874711844902912:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1787864836.797314:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874711844903424 offset 0 length 520: 4 00000020:00080000:0.0:1787864836.810323:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff927566f7b490) has no exports 00000020:01000000:1.0:1787864836.871839:0:15291:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9274470d7120 - data ffff9274424f75e8/ffff927447281400 00000020:01000000:1.0:1787864836.872232:0:15291:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927577709180 - data ffff927572e5ca20/ffff92757bddc400 00000001:00000004:1.0:1787864836.890212:0:15291:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1787864836.967356:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787864836.967369:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1787864836.967380:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787864836.980971:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787864836.980982:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1787864836.981001:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787864836.981004:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787864836.981729:0:8810:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787864836.981738:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1787864836.981751:0:8810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787864836.982598:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787864836.982605:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1787864836.982629:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787864836.982633:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787864836.983111:0:9923:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787864836.983117:0:9923:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1787864836.983127:0:9923:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787864836.988143:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42eec 00000020:00000080:2.0:1787864836.988160:0:15291:0:(genops.c:885:class_export_put()) final put ffff92755ed75800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787864836.989126:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92755ed75800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787864836.991280:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f01 00000020:00000080:2.0:1787864836.991296:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757bdeb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787864836.991351:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787864836.991357:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864836.991380:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787864836.991386:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff927566f7ced8) has no exports 00000004:01000000:2.0:1787864836.991618:0:15291:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787864836.991629:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4320a 00000020:00000080:2.0:1787864836.991634:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757da9c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787864836.992504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bdeb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787864836.992686:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787864836.992756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787864836.992771:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864836.992784:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787864836.992788:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff927446ff0000) has no exports 00000020:00000080:1.0:1787864836.992797:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43203 00000020:00000080:1.0:1787864836.992804:0:15291:0:(genops.c:885:class_export_put()) final put ffff9274481d3800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787864836.992944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9274481d3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787864836.994795:0:15291:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787864836.994805:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787864836.994810:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787864836.994821:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864836.994823:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864836.994958:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864836.994975:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787864836.994985:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc430c8 00000020:00000080:1.0:1787864836.994995:0:15291:0:(genops.c:885:class_export_put()) final put ffff927446e03800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864836.995813:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9274481d5800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787864836.995828:0:8:0:(genops.c:885:class_export_put()) final put ffff92757fa94800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864836.995832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fa94800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787864836.995841:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787864836.996195:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787864836.996203:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864836.996213:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787864836.996219:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff927446ff4ed8) has no exports 00000020:00000080:1.0:1787864836.996228:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc430c1 00000020:00000080:1.0:1787864836.996235:0:15291:0:(genops.c:885:class_export_put()) final put ffff927549bf7000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1787864837.001234:0:15291:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787864837.001246:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787864837.001252:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1787864837.001263:0:15291:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787864837.001266:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864837.001321:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864837.001339:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787864837.001359:0:15291:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787864837.001387:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f24 00000020:00000080:1.0:1787864837.001398:0:15291:0:(genops.c:885:class_export_put()) final put ffff927549bf4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787864837.001406:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787864837.001412:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864837.001418:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787864837.001422:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff92755ef84ed8) has no exports 00000020:00000080:1.0:1787864837.001430:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f1d 00000020:00000080:1.0:1787864837.001434:0:15291:0:(genops.c:885:class_export_put()) final put ffff92755ed75000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787864837.002980:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927446e03800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787864837.003004:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787864837.003012:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757de4c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787864837.003030:0:8:0:(genops.c:885:class_export_put()) final put ffff92757de93800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864837.003034:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757de93800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787864837.003039:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787864837.003149:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787864837.003156:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92755ed75000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787864837.006041:0:15291:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787864837.006053:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787864837.006058:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1787864837.006070:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787864837.006138:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864837.006154:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787864837.006188:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864837.006191:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787864837.006197:0:15291:0:(genops.c:885:class_export_put()) final put ffff92755ed77800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787864837.006203:0:15291:0:(genops.c:844:class_export_destroy()) destroying export ffff92755ed77800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787864837.006220:0:15291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787864837.006428:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f08 00000020:00000080:0.0:1787864837.006435:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757bde9000/lustre-MDD0001_UUID 00000020:01000000:0.0:1787864837.006441:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787864837.006446:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864837.006451:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787864837.006455:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff92757bdf0000) has no exports 00000020:00000080:0.0:1787864837.006479:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864837.006482:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787864837.006486:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f0f 00000020:00000080:0.0:1787864837.006490:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757bdec800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787864837.006498:0:15291:0:(tgt_mount.c:187:server_put_mount()) put mount ffff927547df8000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787864837.006501:0:15291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927547df8000 2 00000020:01000004:0.0:1787864837.006505:0:15291:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff927547df8000 from lustre-MDT0001 00000020:00000080:0.0:1787864837.006524:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864837.006527:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787864837.006530:0:15291:0:(genops.c:885:class_export_put()) final put ffff92755ed73800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787864837.006532:0:15291:0:(genops.c:844:class_export_destroy()) destroying export ffff92755ed73800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787864837.006538:0:15291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787864837.006609:0:15291:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787864837.006613:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787864837.006616:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864837.006620:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787864837.006627:0:15291:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff92757d722000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787864837.006632:0:15291:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff92755ef83490) has exports, disconnecting them 00000020:00080000:0.0:1787864837.006637:0:15291:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff92757d722000), last request at 1787864629 00000020:00000080:0.0:1787864837.006641:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42f63 00000020:00080000:0.0:1787864837.006656:0:15291:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757d722000): rc 0 00000020:00000080:0.0:1787864837.006660:0:15291:0:(genops.c:885:class_export_put()) final put ffff92757d722000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787864837.007438:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92755ed70800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787864837.007448:0:8:0:(genops.c:885:class_export_put()) final put ffff927549bf3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864837.007452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787864837.007459:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787864837.007615:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bde9000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787864837.007620:0:8:0:(genops.c:885:class_export_put()) final put ffff92757bde9800/lustre-MDD0001_UUID 00000020:00000080:2.0:1787864837.007623:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bde9800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787864837.007626:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787864837.007883:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bdec800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787864837.007915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757d722000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787864837.018056:0:15291:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787864837.018069:0:15291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787864837.018075:0:15291:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787864837.018085:0:15291:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787864837.018123:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757d720000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787864837.018350:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864837.018363:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787864837.018369:0:15291:0:(genops.c:885:class_export_put()) final put ffff927549bf0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787864837.018374:0:15291:0:(genops.c:844:class_export_destroy()) destroying export ffff927549bf0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787864837.018384:0:15291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787864837.018474:0:15291:0:(obd_mount.c:710:lustre_put_lsi()) put ffff927547df8000 1 00000020:00000080:2.0:1787864837.018481:0:15291:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42e9f 00000020:00000080:2.0:1787864837.018500:0:15291:0:(genops.c:885:class_export_put()) final put ffff92754ab05000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787864837.018512:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787864837.018521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92754ab05000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787864837.018530:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864837.018535:0:15291:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787864837.018539:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff927566f79a48) has no exports 00000020:00000080:2.0:1787864837.232760:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864837.232780:0:15291:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787864837.232786:0:15291:0:(genops.c:885:class_export_put()) final put ffff927547df9000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787864837.232792:0:15291:0:(genops.c:844:class_export_destroy()) destroying export ffff927547df9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787864837.232806:0:15291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787864837.233004:0:15291:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff927547dfb800 00000020:01000000:2.0:1787864837.233043:0:15291:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787864837.233048:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864837.233053:0:15291:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787864837.233059:0:15291:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff927566f78000) has no exports 00000100:00100000:3.0:1787864837.234747:0:13804:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9274481bf000:13804] 5 exiting: rc = 0 00000100:00100000:3.0:1787864837.234961:0:10168:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9274482faa00:10168] 4 exiting: rc = 0 00000100:00100000:3.0:1787864837.235056:0:8448:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff927446794000:8448] 3 exiting: rc = 0 00000100:00100000:3.0:1787864837.235178:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff927548c09c00:6510] 0 exiting: rc = 1 00000100:00100000:2.0:1787864837.235869:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92754514f800:6511] 1 exiting: rc = 0 00000100:00100000:1.0:1787864837.236100:0:6512:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff927566fa9800:6512] 2 exiting: rc = 0 00000100:00100000:3.0:1787864837.236225:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236236:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236242:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236248:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236254:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236260:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236266:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236272:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236277:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236283:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236289:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236295:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236311:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236323:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236329:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236336:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236341:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236347:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236363:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236371:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236377:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236383:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236388:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236394:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236400:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236405:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236411:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236417:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236423:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236435:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236441:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236448:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236455:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236461:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236467:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236475:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236481:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236487:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236510:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236517:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236522:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236528:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236533:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236539:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236545:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236551:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236558:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236603:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236613:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236620:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236627:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236634:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236642:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236650:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236657:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236664:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236671:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236678:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236684:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236689:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236694:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236700:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236706:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.236713:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864837.242299:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff927566fa9000:6513] 0 exiting: rc = 1 00000100:00100000:1.0:1787864837.242550:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff927543482e00:6514] 1 exiting: rc = 0 00000100:00100000:2.0:1787864837.242782:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242792:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242800:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242807:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242814:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242821:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242829:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242836:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242842:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242851:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242858:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242866:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242874:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242881:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242930:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242938:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242945:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242952:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242959:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242965:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242971:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242978:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242984:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242991:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.242997:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243003:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243021:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243027:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243033:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243434:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243446:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243451:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243458:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243465:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243471:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243497:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243502:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243509:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243514:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243520:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243526:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243532:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243538:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243544:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243550:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243555:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243561:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243577:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243584:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243590:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243596:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243603:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243609:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243615:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243621:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243628:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243634:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243640:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243646:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243652:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243658:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243674:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243681:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.243688:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864837.244545:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92756dfb0000:6515] 0 exiting: rc = 1 00000100:00100000:0.0:1787864837.244597:0:7891:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff92757d95da00:7891] 2 exiting: rc = 0 00000100:00100000:1.0:1787864837.244661:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92756dfb1600:6516] 1 exiting: rc = 0 00000100:00100000:2.0:1787864837.244808:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244820:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244827:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244833:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244841:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244848:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244870:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244925:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244936:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244944:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244958:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244966:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244976:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244984:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.244994:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245001:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245019:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245027:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245034:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245226:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245235:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245241:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245248:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245254:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245262:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245268:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245274:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245281:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245293:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245400:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245409:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245430:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245438:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245444:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245451:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245458:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245465:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245473:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245510:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245519:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245526:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245542:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245548:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245582:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245590:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245596:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245603:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245611:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245617:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245623:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245630:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245637:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245643:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245649:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245660:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245758:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245766:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245775:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245781:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245788:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245795:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245801:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245807:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.245814:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864837.262046:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff927576420000:6518] 1 exiting: rc = 0 00000100:00100000:1.0:1787864837.262073:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92756dfb0800:6517] 0 exiting: rc = 1 00000100:00100000:3.0:1787864837.262200:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262209:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262215:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262220:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262225:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262231:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262236:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262241:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262246:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262252:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262258:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262263:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262269:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262275:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262281:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262287:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262293:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262298:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262326:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262332:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262337:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262342:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262348:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262354:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262359:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262365:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262370:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262379:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262385:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262391:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262397:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262402:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262408:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262414:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262420:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262426:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262432:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262438:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262443:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262449:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262455:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262460:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262466:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262472:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262477:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262482:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262487:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262492:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262498:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262503:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262509:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262515:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262520:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262534:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262540:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262546:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262551:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262557:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262563:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262578:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262584:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262589:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262595:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.262601:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.263078:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92755ef76c00:6519] 0 exiting: rc = 1 00000100:00100000:2.0:1787864837.263199:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92755ef77400:6520] 1 exiting: rc = 0 00000100:00100000:3.0:1787864837.270816:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270831:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270843:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270850:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270858:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270865:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270878:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270884:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270908:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270915:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270923:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270929:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270935:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270940:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270946:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270951:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270956:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270962:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270968:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270973:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270980:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270986:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.270991:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271011:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271016:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271022:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271028:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271033:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271039:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271044:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271049:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271055:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271060:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271066:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271072:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271077:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271082:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271087:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271093:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271099:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271105:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271110:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271115:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271318:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271329:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271335:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271340:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271346:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271351:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271356:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271361:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271366:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271371:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271377:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271382:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271387:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271393:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271398:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271412:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271417:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271422:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271428:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271433:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.271439:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864837.272088:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff92755ef77e00:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1787864837.272088:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff92755ef76a00:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1787864837.273451:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273461:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273467:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273473:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273478:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273484:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273489:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273493:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273498:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273503:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273508:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273514:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273520:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273526:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273532:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273537:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273544:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273550:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273556:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273562:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273577:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273583:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273589:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273594:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273600:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273606:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273613:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273619:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273624:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273650:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273656:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273661:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273668:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273673:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273680:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273685:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273691:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273696:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273702:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273707:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273713:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273718:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273724:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273729:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273734:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273740:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273745:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273751:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273756:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273762:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273767:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273773:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273778:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273784:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273789:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273795:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273801:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273806:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273812:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273817:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273822:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273828:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273834:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.273839:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.274746:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff92755ef76800:6525] 2 exiting: rc = 0 00000100:00100000:1.0:1787864837.274959:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9275429cb600:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1787864837.275507:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9275429ca200:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1787864837.275788:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275796:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275802:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275808:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275814:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275819:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275826:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275831:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275837:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275843:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275849:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275854:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275861:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275866:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275872:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275878:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275883:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275937:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275948:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275955:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275963:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275972:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275979:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275986:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275992:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.275999:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276005:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276011:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276184:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276193:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276199:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276206:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276274:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276284:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276309:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276315:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276321:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276327:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276334:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276340:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276347:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276370:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276380:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276387:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276394:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276399:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276406:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276413:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276419:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276426:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276433:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276439:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276444:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276451:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276457:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276463:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276469:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276476:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276484:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276490:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276497:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276502:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276510:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864837.276515:0:15291:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787864837.284192:0:15291:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864837.284211:0:15291:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787864837.284282:0:15291:0:(genops.c:885:class_export_put()) final put ffff92756de1d000/MDS_uuid 00000020:00000080:2.0:1787864837.284289:0:15291:0:(genops.c:844:class_export_destroy()) destroying export ffff92756de1d000/MDS_uuid for MDS 00000020:01000000:2.0:1787864837.284305:0:15291:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787864837.284509:0:15291:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1787864837.469084:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864838.492482:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864839.516805:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864840.537046:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864841.213049:0:15492:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787864841.238803:0:15492:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787864841.238857:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864841.238917:0:15492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864841.238926:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864841.238933:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864841.239134:0:15492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787864841.239140:0:15492:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787864841.239164:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787864841.239168:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787864841.239175:0:15492:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787864841.239180:0:15492:0:(import.c:65:import_set_state_nolock()) ffff92757da99000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787864841.239185:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787864841.239186:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787864841.239189:0:15492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787864841.240333:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787864841.240338:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787864841.240343:0:15492:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787864841.240363:0:15492:0:(import.c:65:import_set_state_nolock()) ffff92757da9b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787864841.240432:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844903552:0@lo:39:umount.0 00000400:00000100:1.0:1787864841.240504:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844903552 offset 0 length 224: 4 00010000:00010000:0.0:1787864841.240883:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864841.240915:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864841.240926:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ea00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864841.240931:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864841.240941:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864841.240957:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864841.240963:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787864841.240966:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787864841.240969:0:10329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787864841.240999:0:10329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:0.0:1787864841.241004:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864841.241011:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc432ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432f1 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864841.241023:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864841.241025:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864841.241027:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787864841.497263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787864841.497273:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864841.497275:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787864841.497278:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787864841.497283:0:38:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864841.497291:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 361 00000100:00080000:0.0:1787864841.497296:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787864841.497302:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff927447eba800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864841.497340:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc15680 x1874711844903680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787864841.497493:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844903680:0@lo:38:kworker.0 00000400:00000100:1.0:1787864841.497552:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844903680 offset 0 length 520: 4 00000100:00100000:2.0:1787864841.498375:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844903808:0@lo:400:kworker.0 00000400:00000100:2.0:1787864841.498404:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844903808 offset 0 length 224: 4 00010000:00010000:2.0:1787864841.561167:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864842.585098:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787864843.037420:0:8419:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787864843.037428:0:8419:0:(genops.c:885:class_export_put()) final put ffff92744679f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864843.037690:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92744679f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787864843.037746:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92744679d000 for lustre-OST0000 00000001:00100000:2.0:1787864843.038769:0:9504:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787864843.038775:0:9504:0:(genops.c:885:class_export_put()) final put ffff927447eab000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787864843.038847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787864843.038931:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447ea9000 for lustre-OST0001 00010000:00010000:2.0:1787864843.609438:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864844.633281:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864845.662278:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864846.617004:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864836/real 1787864836] req@ffff92757dc16d00 x1874711844903424/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787864846 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864846.617034:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92757dc16d00 x1874711844903424/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787864846 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864846.617069:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864846.617095:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787864846.617099:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844903424:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1787864846.617179:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787864846.617184:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787864846.617187:0:8:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864846.617192:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.136@tcp: connect to NID 0@lo last attempt 361 00000100:00080000:2.0:1787864846.617196:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.136@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787864846.617203:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.136@tcp: import ffff927573276800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864846.617229:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c4000 x1874711844903936/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864846.617254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787864846.617258:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787864846.617340:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864846.617353:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844904064:0@lo:400:kworker.0 00000400:00000100:1.0:1787864846.617397:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844904064 offset 0 length 224: 4 00000100:00100000:3.0:1787864846.617649:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844903936:0@lo:250:kworker.0 00000400:00000100:3.0:1787864846.617670:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874711844903936 offset 0 length 520: 4 00010000:00010000:2.0:1787864846.681534:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864847.705144:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864848.729195:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864849.754097:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864850.777095:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787864851.737985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787864851.738003:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864851.738007:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787864851.738010:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787864851.738197:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864851.738217:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844904192:0@lo:400:kworker.0 00000400:00000100:3.0:1787864851.738274:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844904192 offset 0 length 224: 4 00000100:00100000:1.0:1787864851.738289:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864841/real 1787864841] req@ffff927448bff0c0 x1874711844903552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787864851 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864851.738324:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff927448bff0c0 x1874711844903552/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787864851 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787864851.738339:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757da9b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787864851.738358:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844903552:0@lo:39:umount.0 00000100:00080000:1.0:1787864851.738408:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787864851.738412:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787864851.738417:0:15492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787864851.740167:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740186:0:15492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740193:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740201:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740216:0:15492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864851.740438:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864851.740445:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864851.740453:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757db30400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864851.740457:0:6500:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864851.740465:0:6500:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864851.740473:0:6500:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864851.740479:0:6500:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787864851.740481:0:6500:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787864851.740591:0:6500:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:2.0:1787864851.740596:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864851.740604:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864851.740606:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864851.740608:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864851.740733:0:15492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757db30400/0x2fcb8c294dc432f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432ff expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740749:0:15492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740756:0:15492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740763:0:15492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740769:0:15492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864851.740919:0:15492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787864851.740925:0:15492:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787864851.740930:0:15492:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787864851.740957:0:15492:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787864851.740960:0:15492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787864851.740965:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864851.740972:0:15492:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787864851.740975:0:15492:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff92757bc30000) has no exports 00010000:00010000:0.0:1787864851.741091:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864851.741098:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864851.741115:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864851.741118:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864851.741126:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864851.741132:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864851.741137:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787864851.741139:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787864851.741140:0:10329:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787864851.741149:0:10329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:0.0:1787864851.741153:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864851.741158:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796200/0x2fcb8c294dc43560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc43567 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864851.741167:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864851.741169:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864851.741171:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787864851.741782:0:15492:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff92757bc30000) has no exports 00000020:01000000:1.0:1787864851.745578:0:15492:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927447e0bcc0 - data ffff927572c1f798/ffff92757dcdec00 00000020:01000000:1.0:1787864851.745729:0:15492:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff92756ded1120 - data ffff927572e61360/ffff92744227d000 00100000:10000000:1.0:1787864851.775574:0:15492:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787864851.795745:0:15492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4303c 00000020:00000080:2.0:1787864851.795756:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757da9e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787864851.795778:0:15492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757bdea800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787864851.795789:0:15492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757bdea800 2 00000020:01000004:2.0:1787864851.795793:0:15492:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92757bdea800 from lustre-OST0000 00000020:00000080:2.0:1787864851.795814:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864851.795823:0:15492:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787864851.795935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787864851.796956:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757da9a000/lustre-OST0000_UUID 00000020:00000080:2.0:1787864851.796961:0:15492:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787864851.796968:0:15492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787864851.797448:0:15492:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787864851.797454:0:15492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787864851.797458:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864851.797464:0:15492:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787864851.797470:0:15492:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92757da9a800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787864851.797476:0:15492:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff92757bdf3490) has exports, disconnecting them 00000020:00080000:2.0:1787864851.797481:0:15492:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92757da9a800), last request at 1787864647 00000020:00000080:2.0:1787864851.797485:0:15492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43066 00000020:00080000:2.0:1787864851.797512:0:15492:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757da9a800): rc 0 00000020:00000080:2.0:1787864851.797516:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757da9a800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787864851.797673:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9a800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:00010000:0.0:1787864851.801060:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1787864851.806960:0:15492:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787864851.806969:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787864851.806984:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787864851.807001:0:15492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787864851.807180:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864851.807188:0:15492:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787864851.807194:0:15492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787864851.807199:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864851.807202:0:15492:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787864851.807209:0:15492:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff92757da9c000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787864851.807216:0:15492:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff927446ff1a48) has exports, disconnecting them 00000020:00080000:0.0:1787864851.807233:0:15492:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff92757da9c000), last request at 1787864647 00000020:00000080:0.0:1787864851.807238:0:15492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4307b 00000020:00080000:0.0:1787864851.807253:0:15492:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92757da9c000): rc 0 00000020:00000080:0.0:1787864851.807259:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757da9c000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787864851.807866:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757da99000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787864851.807875:0:38:0:(genops.c:885:class_export_put()) final put ffff92757de93000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787864851.807878:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757de93000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787864851.807902:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787864851.807957:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9c000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787864851.807979:0:15492:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787864851.807982:0:15492:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787864851.807985:0:15492:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787864851.807989:0:15492:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864851.808002:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92757da9b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1787864851.808108:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864851.808113:0:15492:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1787864851.808116:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757da9e000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1787864851.808118:0:15492:0:(genops.c:844:class_export_destroy()) destroying export ffff92757da9e000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1787864851.808122:0:15492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787864851.808154:0:15492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757bdea800 1 00000020:00000080:1.0:1787864851.808159:0:15492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43004 00000020:00000080:1.0:1787864851.808163:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757bded000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787864851.808170:0:15492:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787864851.808176:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bded000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787864851.808183:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864851.808186:0:15492:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787864851.808189:0:15492:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff92757bdf1a48) has no exports 00000020:00000080:1.0:1787864851.889196:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864851.889208:0:15492:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787864851.889213:0:15492:0:(genops.c:885:class_export_put()) final put ffff92757bdea000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787864851.889217:0:15492:0:(genops.c:844:class_export_destroy()) destroying export ffff92757bdea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787864851.889227:0:15492:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787864851.889433:0:15492:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92757bdeb800 00000020:02000400:1.0:1787864851.889650:0:15492:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787864852.825189:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864853.849124:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864854.873104:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787864855.155771:0:15695:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787864855.174193:0:15695:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787864855.174282:0:15695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864855.174297:0:15695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864855.174304:0:15695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864855.174311:0:15695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864855.174329:0:15695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787864855.174334:0:15695:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787864855.174373:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787864855.174385:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dc15680 x1874711844903680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787864861 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864855.174422:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787864855.174429:0:15695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787864855.174435:0:15695:0:(import.c:65:import_set_state_nolock()) ffff927447eba800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787864855.174441:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787864855.174446:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dc15680 x1874711844903680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787864861 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864855.174453:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787864855.174457:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1787864855.174538:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844903680:0@lo:38:kworker.0 00010000:00010000:0.0:1787864855.174643:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864855.174651:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864855.174658:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949800 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864855.174662:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864855.174670:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864855.174677:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864855.174682:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787864855.174684:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787864855.174687:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787864855.174708:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:0.0:1787864855.174712:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864855.174720:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949800/0x2fcb8c294dc432ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432d5 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864855.174731:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864855.174732:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864855.174734:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864855.177483:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787864855.177498:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dc143c0 x1874711844903808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864857 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864855.177517:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9274490c5680 x1874711844904064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864855.177534:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9274490c7840 x1874711844904192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864867 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864855.177550:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:3.0:1787864855.177587:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844904192:0@lo:400:kworker.0 00000100:00080000:2.0:1787864855.177596:0:15695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787864855.177621:0:15695:0:(import.c:65:import_set_state_nolock()) ffff927447ebf800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787864855.177707:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844904064:0@lo:400:kworker.0 00000100:00100000:0.0:1787864855.177906:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3640:1874711844903808:0@lo:400:kworker.0 00000100:00100000:3.0:1787864855.178181:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844904320:0@lo:39:umount.0 00000400:00000100:3.0:1787864855.178223:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874711844904320 offset 0 length 224: 4 00010000:00010000:2.0:1787864855.898430:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787864856.857456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787864856.857474:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787864856.921213:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864857.945420:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864858.969115:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864859.995327:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864861.017501:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864861.337061:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864846/real 1787864846] req@ffff9274490c4000 x1874711844903936/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787864861 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864861.337118:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c4000 x1874711844903936/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787864861 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864861.337139:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864861.337169:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787864861.337173:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844903936:0@lo:250:kworker.0 00000100:00080000:0.0:1787864861.337266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787864861.337271:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787864861.337274:0:8:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864861.337278:0:8:0:(import.c:510:import_select_connection()) MGC192.168.206.136@tcp: connect to NID 0@lo last attempt 371 00000100:00080000:0.0:1787864861.337283:0:8:0:(import.c:589:import_select_connection()) MGC192.168.206.136@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787864861.337289:0:8:0:(import.c:624:import_select_connection()) MGC192.168.206.136@tcp: import ffff927573276800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864861.337315:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc143c0 x1874711844904448/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864861.337497:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844904448:0@lo:250:kworker.0 00000400:00000100:3.0:1787864861.337538:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874711844904448 offset 0 length 520: 4 00010000:00010000:3.0:1787864862.041546:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864863.065510:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864864.089149:0:10328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864865.117401:0:6500:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864865.433133:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864855/real 1787864855] req@ffff9274490c4b40 x1874711844904320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787864865 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864865.433167:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c4b40 x1874711844904320/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787864865 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864865.433187:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927447ebf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787864865.433208:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844904320:0@lo:39:umount.0 00000100:00080000:2.0:1787864865.433458:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787864865.433477:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787864865.433481:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787864865.435786:0:15695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435804:0:15695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435811:0:15695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435817:0:15695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435942:0:15695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864865.435951:0:15695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435958:0:15695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435965:0:15695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.435971:0:15695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436118:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864865.436125:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436132:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864865.436136:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436145:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864865.436169:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864865.436175:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787864865.436177:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1787864865.436187:0:10329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:3.0:1787864865.436191:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436197:0:10329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927446796600/0x2fcb8c294dc432dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc432e3 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436211:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864865.436214:0:10329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436220:0:10329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864865.436223:0:10329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436229:0:10329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864865.436235:0:10329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864865.436240:0:10329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787864865.436242:0:10329:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787864865.436245:0:10329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:3.0:1787864865.436252:0:10329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864865.436259:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864865.436261:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864865.436263:0:10329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864865.436320:0:15695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787864865.436324:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949600/0x2fcb8c294dc43552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc43559 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864865.436345:0:15695:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787864865.436349:0:15695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787864865.436352:0:15695:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787864865.436373:0:15695:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787864865.436377:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787864865.436380:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864865.436385:0:15695:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787864865.436389:0:15695:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff92755ed9b490) has no exports 00000020:00080000:2.0:1787864865.439844:0:15695:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff92755ed9b490) has no exports 00010000:00010000:0.0:1787864865.441001:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787864865.444234:0:15695:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927447e0b0c0 - data ffff927442423000/ffff92757dcde400 00000020:01000000:2.0:1787864865.444383:0:15695:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff927447e0bb40 - data ffff9274424f2d80/ffff92744821d000 00100000:10000000:2.0:1787864865.455585:0:15695:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787864865.466515:0:15695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43162 00000020:00000080:2.0:1787864865.466526:0:15695:0:(genops.c:885:class_export_put()) final put ffff92757fad3800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787864865.466543:0:15695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92757de48800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787864865.466546:0:15695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757de48800 2 00000020:01000004:2.0:1787864865.466549:0:15695:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92757de48800 from lustre-OST0001 00000020:00000080:2.0:1787864865.466569:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864865.466577:0:15695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787864865.466580:0:15695:0:(genops.c:885:class_export_put()) final put ffff92757fad2800/lustre-OST0001_UUID 00000020:00000080:2.0:1787864865.466583:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fad2800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787864865.466590:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787864865.466773:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fad3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1787864865.467152:0:15695:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f->MGS 00010000:00010000:2.0:1787864865.467169:0:15695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030a00/0x2fcb8c294dc42ebb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864865.467182:0:15695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030a00/0x2fcb8c294dc42ebb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864865.467189:0:15695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787864865.467200:0:15695:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787864865.467204:0:15695:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787864865.467218:0:15695:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:2.0:1787864865.467221:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030a00/0x2fcb8c294dc42ebb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc42ec2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864865.467236:0:15695:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864865.467255:0:15695:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864865.467260:0:15695:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787864865.467262:0:15695:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787864865.467264:0:15695:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787864865.467282:0:15695:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff927573276800 00010000:00010000:2.0:1787864865.467285:0:15695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc4333e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2fcb8c294dc43345 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787864865.467302:0:15695:0:(import.c:65:import_set_state_nolock()) ffff927573276800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787864865.467305:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787864865.467308:0:15695:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787864865.467309:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787864865.467314:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787864865.467324:0:15695:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92757dc143c0 x1874711844904448/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787864881 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787864865.467346:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787864865.467349:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1787864865.467480:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f:3636:1874711844904448:0@lo:250:kworker.0 10000000:01000000:2.0:1787864865.467719:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787864865.467727:0:15695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc42db8 00000020:00000080:2.0:1787864865.467731:0:15695:0:(genops.c:885:class_export_put()) final put ffff92756de1f800/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f 00000020:01000000:2.0:1787864865.467757:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.136@tcp (flags='') 00000020:00000080:0.0:1787864865.467767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92756de1f800/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f for MGC192.168.206.136@tcp 00000020:00000080:2.0:1787864865.467768:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864865.467775:0:15695:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.136@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787864865.467779:0:15695:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff92755ed9ced8) has no exports 10000000:01000000:0.0:1787864865.467821:0:6508:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787864865.467972:0:15695:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.136@tcp: client import never connected 00000100:00080000:2.0:1787864865.468041:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787864865.468044:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787864865.468047:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787864865.468049:0:15695:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787864865.468136:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927573276800 for MGC192.168.206.136@tcp 00000020:00000080:2.0:1787864865.468149:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787864865.468155:0:15695:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.136@tcp (uuid 01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f) 00000020:00000080:2.0:1787864865.468158:0:15695:0:(genops.c:885:class_export_put()) final put ffff927573270800/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f 00000020:00000080:2.0:1787864865.468161:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff927573270800/01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f for MGC192.168.206.136@tcp 00000020:01000000:2.0:1787864865.468166:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.136@tcp (01c04e8c-79f4-4cfc-ad56-3fd460fa6d9f) 00000020:01000000:2.0:1787864865.468565:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787864865.468570:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787864865.468574:0:15695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787864865.468579:0:15695:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff927447eba000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787864865.468585:0:15695:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff92755ed98000) has exports, disconnecting them 00000020:00080000:2.0:1787864865.468589:0:15695:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff927447eba000), last request at 1787864666 00000020:00000080:2.0:1787864865.468593:0:15695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc4318c 00000020:00080000:2.0:1787864865.468671:0:15695:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff927447eba000): rc 0 00000020:00000080:2.0:1787864865.468675:0:15695:0:(genops.c:885:class_export_put()) final put ffff927447eba000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787864865.468779:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eba000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787864865.472975:0:15695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787864865.472983:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787864865.472987:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787864865.472994:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787864865.473183:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447eba800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787864865.475266:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787864865.475278:0:15695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787864865.475284:0:15695:0:(genops.c:885:class_export_put()) final put ffff92757fad3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787864865.475288:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff92757fad3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787864865.475300:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1787864865.475371:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787864865.475375:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787864865.475806:0:15695:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787864865.475814:0:15695:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff927447eb9800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787864865.475820:0:15695:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff927447fd3490) has exports, disconnecting them 00000020:00080000:1.0:1787864865.475825:0:15695:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff927447eb9800), last request at 1787864666 00000020:00000080:1.0:1787864865.475828:0:15695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc431a1 00000020:00080000:1.0:1787864865.475857:0:15695:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff927447eb9800): rc 0 00000020:00000080:1.0:1787864865.475862:0:15695:0:(genops.c:885:class_export_put()) final put ffff927447eb9800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787864865.478816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eb9800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787864865.498968:0:15695:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787864865.498978:0:15695:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787864865.498982:0:15695:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787864865.498989:0:15695:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787864865.499020:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff927447ebf800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787864865.499234:0:10328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787864865.499435:0:6500:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787864865.500682:0:10329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787864865.501005:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1787864865.501134:0:13719:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff927447285600:13719] 2 exiting: rc = 0 00000100:00100000:3.0:1787864865.501259:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff927566f6e800:6494] 0 exiting: rc = 1 00000100:00100000:3.0:1787864865.501322:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff927566f6fa00:6495] 1 exiting: rc = 0 00000100:00100000:0.0:1787864865.501424:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.501990:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff927566e74a00:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1787864865.502064:0:6498:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff927566e75600:6498] 2 exiting: rc = 0 00000100:00100000:0.0:1787864865.502128:0:14659:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff927542df5e00:14659] 3 exiting: rc = 0 00000100:00100000:2.0:1787864865.502400:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff927566e72400:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1787864865.502458:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502477:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502483:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502489:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502494:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502499:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502504:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502509:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502514:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502519:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502524:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502530:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502535:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502541:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502559:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502565:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502578:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502585:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502590:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502597:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502610:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502616:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502621:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502628:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502632:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502638:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502643:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502649:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502654:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502659:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502665:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502670:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502675:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502698:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502704:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502710:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502717:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502725:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502747:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502755:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502761:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502767:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502772:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502778:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502783:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502788:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502793:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502799:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502804:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502817:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502823:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502829:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502834:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502839:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502845:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502850:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502855:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502860:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502864:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502869:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502875:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.502880:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.503078:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.503092:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787864865.505338:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864865.505350:0:15695:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787864865.505355:0:15695:0:(genops.c:885:class_export_put()) final put ffff927447eb9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787864865.505360:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff927447eb9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787864865.505367:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787864865.505424:0:15695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92757de48800 1 00000020:00000080:0.0:1787864865.505430:0:15695:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2fcb8c294dc43131 00000020:00000080:0.0:1787864865.505436:0:15695:0:(genops.c:885:class_export_put()) final put ffff927446e03000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787864865.505448:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787864865.505459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff927446e03000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787864865.505481:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864865.505486:0:15695:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787864865.505490:0:15695:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff92757bc31a48) has no exports 00000020:00000080:0.0:1787864865.572588:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864865.572603:0:15695:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787864865.572608:0:15695:0:(genops.c:885:class_export_put()) final put ffff92757de49000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787864865.572612:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff92757de49000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787864865.572618:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787864865.573141:0:15695:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92757de4c000 00000020:01000000:0.0:1787864865.573169:0:15695:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787864865.573173:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787864865.573178:0:15695:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787864865.573181:0:15695:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff92757bdf4ed8) has no exports 00000020:00000080:0.0:1787864865.573206:0:15695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787864865.573212:0:15695:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787864865.573215:0:15695:0:(genops.c:885:class_export_put()) final put ffff92757de90000/OSS_uuid 00000020:00000080:0.0:1787864865.573217:0:15695:0:(genops.c:844:class_export_destroy()) destroying export ffff92757de90000/OSS_uuid for OSS 00000020:01000000:0.0:1787864865.573220:0:15695:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787864865.573304:0:6506:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787864865.573381:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff92757d968a00:8423] 0 exiting: rc = 1 00000100:00100000:0.0:1787864865.587749:0:14166:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff92744813c000:14166] 4 exiting: rc = 0 00000100:00100000:1.0:1787864865.587872:0:8820:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff927446df7800:8820] 3 exiting: rc = 0 00000100:00100000:2.0:1787864865.589004:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92757d70e400:8425] 1 exiting: rc = 0 00000100:00100000:0.0:1787864865.589251:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff92757d70ec00:8426] 2 exiting: rc = 0 00000100:00100000:1.0:1787864865.589411:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589430:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589436:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589442:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589448:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589454:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589459:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589464:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589468:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589474:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589479:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589484:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589490:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589495:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589500:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589504:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589509:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589514:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589519:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589524:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589529:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589535:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589542:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589547:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589553:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589559:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589564:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589571:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589577:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589584:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589604:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589614:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589692:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589696:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589701:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589705:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589710:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589714:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589719:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589723:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589729:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589733:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589738:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589743:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589749:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589766:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589774:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589778:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589783:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589787:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589793:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589797:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589802:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589807:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589812:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589818:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589822:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589827:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589832:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589837:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589842:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589847:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589853:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.589858:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787864865.592460:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92757d70f000:8428] 1 exiting: rc = 0 00000100:00100000:0.0:1787864865.592551:0:10088:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff927446fe0e00:10088] 2 exiting: rc = 0 00000100:00100000:1.0:1787864865.592790:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92757d70f200:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1787864865.593126:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593135:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593140:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593152:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593157:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593163:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593168:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593173:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593178:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593183:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593189:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593194:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593199:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593204:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593209:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593214:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593225:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593231:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593236:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593241:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593247:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593262:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593267:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593272:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593278:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593283:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593289:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593294:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593299:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593304:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593309:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593314:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593319:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593349:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593355:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593360:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593365:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593369:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593381:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593385:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593390:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593394:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593399:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593403:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593407:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593422:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593428:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593434:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593439:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593444:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593450:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593455:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593460:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593465:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593469:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593475:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593479:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593484:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593492:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593498:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593504:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593508:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593513:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.593524:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.597552:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff92757d70fe00:8429] 0 exiting: rc = 1 00000100:00100000:1.0:1787864865.597855:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9275776ed400:8430] 1 exiting: rc = 0 00000100:00100000:3.0:1787864865.601981:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9275776ecc00:8431] 2 exiting: rc = 0 00000100:00100000:1.0:1787864865.602144:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602154:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602161:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602167:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602172:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602177:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602182:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602188:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602194:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602210:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602217:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602234:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602240:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602244:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602250:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602255:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602260:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602266:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602271:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602276:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602282:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602287:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602292:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602297:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602302:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602308:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602313:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602319:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602324:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602330:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602336:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602342:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602361:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602382:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602390:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602394:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602398:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602403:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602408:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602422:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602428:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602434:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602439:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602444:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602450:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602456:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602460:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602466:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602471:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602477:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602482:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602487:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602492:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602498:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602504:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602510:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602516:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602535:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602541:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602547:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602552:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602557:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602562:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.602568:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.607824:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9275776e8000:8432] 0 exiting: rc = 1 00000100:00100000:2.0:1787864865.611191:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff92757d961c00:8433] 1 exiting: rc = 0 00000100:00100000:3.0:1787864865.611718:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611725:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611729:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611734:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611739:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611744:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611749:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611754:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611759:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611763:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611767:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611772:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611777:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611781:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611786:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611791:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611797:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611801:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611806:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611810:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611814:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611819:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611823:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611842:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611846:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611851:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611855:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611864:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611869:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611874:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611878:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611884:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611902:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611908:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611913:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611918:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611923:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611927:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611932:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611937:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611941:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611946:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611951:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611956:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611961:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611967:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611973:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611978:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611983:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611987:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611992:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.611997:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612001:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612005:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612010:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612014:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612019:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612024:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612037:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612042:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612054:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612060:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612066:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787864865.612071:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787864865.613682:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff92757d960600:8434] 0 exiting: rc = 1 00000100:00100000:3.0:1787864865.613882:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff92757d960c00:8435] 1 exiting: rc = 0 00000100:00100000:2.0:1787864865.614196:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614202:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614207:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614212:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614218:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614223:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614229:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614246:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614262:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614268:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614274:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614279:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614284:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614289:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614294:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614300:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614305:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614310:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614315:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614320:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614336:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614342:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614348:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614353:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614358:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614363:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614369:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614374:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614380:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614385:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614390:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614395:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614499:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614508:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614514:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614520:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614525:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614531:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614537:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614544:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614550:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614555:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614569:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614575:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614595:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614602:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614608:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614613:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614619:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614625:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614630:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614637:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614644:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614651:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614656:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614664:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614685:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614692:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614697:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614702:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614707:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614711:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614717:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787864865.614723:0:15695:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787864865.628627:0:15695:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787864884.989713:0:16461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787864894.219832:0:17060:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787864894.219838:0:17060:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787864894.219840:0:17060:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787864894.219987:0:17060:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92754c99c000 00000020:01000004:2.0:1787864894.220002:0:17060:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787864894.220008:0:17060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787864894.220021:0:17060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff927448294ed8) 00000020:00000080:2.0:1787864894.220034:0:17060:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787864894.321474:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.322104:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787864894.324390:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787864894.325582:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.325872:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.326292:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.326499:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.326681:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.327028:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.327283:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.327486:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.327676:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.327975:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.328161:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.328495:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.329125:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.329469:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.329648:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.330011:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.330389:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.330621:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.331132:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.331510:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.332004:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.332256:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.332465:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787864894.332639:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.333055:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.333275:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.333495:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787864894.333964:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787864894.334319:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1787864894.334518:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1787864894.335045:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787864894.335245:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787864894.335732:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.336201:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.336418:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.336635:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.337056:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.337238:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.337432:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.337652:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.338044:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787864894.338282:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.338513:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.338871:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.340520:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.341161:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.341368:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.342058:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.342252:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787864894.342529:0:17060:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1787864894.343824:0:17060:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787864894.344117:0:17060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787864894.344125:0:17060:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787864894.344137:0:17060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc44375 00000020:01000004:0.0:1787864894.344144:0:17060:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1787864894.344148:0:17060:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787864894.344153:0:17060:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92754c99c000 from MGS 00000020:01000004:0.0:1787864894.344156:0:17060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787864894.344165:0:17060:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff92754aaf4ed8) 00000020:00000080:0.0:1787864894.344175:0:17060:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787864894.344232:0:17060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754c99c000 from MGS, refs=2 00080000:01000000:0.0:1787864894.344237:0:17060:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787864894.344241:0:17060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc44383 00000100:00100000:0.0:1787864894.344350:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787864894.344484:0:17060:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787864894.344489:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787864894.345144:0:17060:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787864894.345151:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787864894.345816:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864894.346032:0:17060:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787864894.346038:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787864894.346632:0:17060:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787864894.346639:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787864894.347581:0:17060:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787864894.347649:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787864894.348956:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864894.348961:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864894.348963:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864894.349278:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864894.349280:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864894.349282:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864894.349927:0:17060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787864894.352369:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787864894.362565:0:17060:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787864894.366772:0:17072:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787864894.366930:0:17060:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787864894.366981:0:17060:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787864894.368676:0:17060:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787864894.369010:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864894.369168:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787864894.369173:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787864894.379377:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787864894.379389:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787864894.389727:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787864894.389739:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787864894.390815:0:17060:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787864894.390835:0:17060:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.136@tcp' 00000020:01000004:0.0:1787864894.390837:0:17060:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787864894.390863:0:17060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.136@tcp (typ=mgc) 00000020:00000080:0.0:1787864894.390875:0:17060:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.136@tcp (ffff92754aaf1a48) 00000100:00080000:2.0:1787864894.391204:0:17077:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787864894.391267:0:17060:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787864894.391338:0:17060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757fb46000@MGC192.168.206.136@tcp: add connection 192.168.206.136@tcp at head 00010000:00010000:0.0:1787864894.391535:0:17060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.136@tcp-0 is initialized 00000040:01000000:0.0:1787864894.391541:0:17060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787864894.393758:0:17078:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787864894.393927:0:17060:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.136@tcp (uuid af099440-ba6e-4600-a03b-1ca45ea8912e) 00000020:00000080:0.0:1787864894.393950:0:17060:0:(genops.c:1385:class_connect()) connect: client af099440-ba6e-4600-a03b-1ca45ea8912e, cookie 0x2fcb8c294dc44391 00000100:00080000:0.0:1787864894.393963:0:17060:0:(import.c:510:import_select_connection()) MGC192.168.206.136@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787864894.393970:0:17060:0:(import.c:624:import_select_connection()) MGC192.168.206.136@tcp: import ffff92757fb46000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864894.394005:0:17060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc161c0 x1874711844904576/t0(0) o250->MGC192.168.206.136@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787864894.394035:0:17060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import af099440-ba6e-4600-a03b-1ca45ea8912e->MGS 00000020:01000004:0.0:1787864894.394059:0:17060:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787864894.394064:0:17060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787864894.394078:0:17060:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff92754aaf0000) 00000020:00000080:0.0:1787864894.394089:0:17060:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787864894.394563:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af099440-ba6e-4600-a03b-1ca45ea8912e:3636:1874711844904576:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787864894.394646:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.394927:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844904576 00000100:00100000:2.0:1787864894.394934:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844904576 00000100:00100000:2.0:1787864894.394976:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864894.394983:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3636:x1874711844904576:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787864894.395007:0:17073:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from af099440-ba6e-4600-a03b-1ca45ea8912e@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:2.0:1787864894.395029:0:17073:0:(genops.c:1385:class_connect()) connect: client af099440-ba6e-4600-a03b-1ca45ea8912e, cookie 0x2fcb8c294dc4439f 00000100:00080000:2.0:1787864894.395151:0:17073:0:(import.c:65:import_set_state_nolock()) ffff92754c99b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864894.395205:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+5:3636:x1874711844904576:12345-0@lo:250:mount.lustre.0 Request processed in 221us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.395212:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864894.395733:0:3636:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.136@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787864894.395742:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.136@tcp: connect to target with instance 0 00000100:00080000:3.0:1787864894.395749:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.136@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787864894.395753:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787864894.395757:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757fb46000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787864894.395771:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787864894.395782:0:3636:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787864894.395788:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:af099440-ba6e-4600-a03b-1ca45ea8912e:3636:1874711844904576:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787864894.424537:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864894.425044:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787864894.425052:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787864894.429233:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787864894.429249:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787864894.429825:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787864894.429834:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787864894.430510:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787864894.430802:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787864894.430808:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787864894.434776:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787864894.434790:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787864894.480608:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864894.480800:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787864894.480806:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787864894.487528:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787864894.487543:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787864894.488238:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864894.488409:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787864894.488415:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787864894.489192:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787864894.489200:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787864894.489722:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864894.489881:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787864894.489923:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787864894.490565:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787864894.490572:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787864894.491312:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864894.491571:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787864894.491577:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787864894.492157:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787864894.492165:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787864894.523129:0:17060:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864894.523333:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787864894.523340:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787864894.525353:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787864894.525365:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787864894.530463:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787864894.530483:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787864894.532296:0:17060:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787864894.532324:0:17060:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1787864894.532330:0:17060:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787864894.532428:0:17060:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787864894.532461:0:17060:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.136@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787864894.532466:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787864894.532467:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787864894.532469:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864894.532470:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864894.532471:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864894.532473:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864894.532474:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864894.532476:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787864894.532478:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864894.532479:0:17060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787864894.532481:0:17060:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787864894.532484:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864894.532485:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787864894.532486:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864894.532487:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864894.532488:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864894.532489:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864894.532490:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864894.532491:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787864894.532492:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864894.532493:0:17060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787864894.532532:0:17060:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787864894.532552:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904704:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787864894.532637:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864894.532687:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275459343c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864894.533114:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844904704 00000100:00100000:1.0:1787864894.533121:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844904704 00000100:00100000:1.0:1787864894.533171:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864894.533180:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+5:17060:x1874711844904704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787864894.533223:0:17076:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787864894.533227:0:17076:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787864894.533229:0:17076:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787864894.533588:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787864894.534127:0:17076:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1787864894.536280:0:17098:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787864894.536287:0:17098:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1787864894.536290:0:17098:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787864894.536293:0:17098:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787864894.536478:0:17098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787864894.536730:0:17076:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787864894.536739:0:17076:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787864894.538739:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+5:17060:x1874711844904704:12345-0@lo:253:mount.lustre.0 Request processed in 5551us (6091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.538756:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864894.539173:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904704:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787864894.539189:0:17060:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787864894.539193:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864894.539194:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787864894.539196:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864894.539197:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864894.539198:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864894.539199:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864894.539201:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864894.539202:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787864894.539204:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864894.539205:0:17060:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787864894.539227:0:17060:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92754c99c000 from lustre-MDT0000 10000000:01000000:3.0:1787864894.539267:0:17060:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787864894.539270:0:17060:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787864894.539274:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92754aaf1a48 10000000:01000000:3.0:1787864894.539279:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864894.539287:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92754aaf1a48 from 1 10000000:01000000:3.0:1787864894.539289:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787864894.539321:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.539331:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.539341:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864894.539359:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864894.539395:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864894.539517:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548b916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.539561:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844904832 00000100:00100000:2.0:1787864894.539578:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844904832 00000100:00100000:2.0:1787864894.539714:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864894.539724:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+5:17060:x1874711844904832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864894.539735:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864894.539749:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387b400/0x2fcb8c294dc443ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc443a6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.539782:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387b400/0x2fcb8c294dc443ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc443a6 expref: 6 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.539792:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387b400/0x2fcb8c294dc443ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc443a6 expref: 6 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.539801:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387b400, rc 0) 00000100:00100000:2.0:1787864894.539847:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+6:17060:x1874711844904832:12345-0@lo:101:mount.lustre.0 Request processed in 125us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.539853:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864894.539926:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864894.539938:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.539947:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.540000:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864894.540028:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.540299:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.540360:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844904960 00000100:00100000:3.0:1787864894.540366:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844904960 00000100:00100000:3.0:1787864894.540392:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864894.540397:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+6:17060:x1874711844904960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864894.540556:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+6:17060:x1874711844904960:12345-0@lo:501:mount.lustre.0 Request processed in 157us (526us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787864894.540562:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864894.540693:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844904960:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787864894.540723:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787864894.540740:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.540748:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864894.540757:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92754c99c000 10000000:01000000:0.0:1787864894.540776:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787864894.540780:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92754c99c000 10000000:01000000:0.0:1787864894.540783:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787864894.540786:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92754c99c000 from 1 10000000:01000000:0.0:1787864894.540788:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787864894.540808:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.540815:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.540823:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.540837:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787864894.540863:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.540877:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.540997:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905088 00000100:00100000:3.0:1787864894.541001:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905088 00000100:00100000:3.0:1787864894.541021:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864894.541026:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+6:17060:x1874711844905088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864894.541033:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864894.541045:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824f800/0x2fcb8c294dc443bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc443b4 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.541060:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824f800/0x2fcb8c294dc443bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc443b4 expref: 7 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.541068:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824f800/0x2fcb8c294dc443bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc443b4 expref: 7 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.541075:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f800, rc 0) 00000100:00100000:3.0:1787864894.541112:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+7:17060:x1874711844905088:12345-0@lo:101:mount.lustre.0 Request processed in 86us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.541119:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864894.541250:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864894.541271:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443bb expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.541279:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc443bb expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864894.541290:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787864894.541304:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443bb expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.541311:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5ba600/0x2fcb8c294dc443b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443bb expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864894.541324:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787864894.541327:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864894.541331:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92754c99c000 10000000:01000000:0.0:1787864894.541334:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787864894.541337:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787864894.541339:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864894.541353:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.541359:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.541366:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.541378:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787864894.541405:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.541534:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905216 00000100:00100000:2.0:1787864894.541538:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905216 00000100:00100000:2.0:1787864894.541567:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864894.541574:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+7:17060:x1874711844905216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864894.541580:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864894.541588:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387b600/0x2fcb8c294dc443c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc443c2 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.541611:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387b600/0x2fcb8c294dc443c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc443c2 expref: 8 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.541619:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387b600/0x2fcb8c294dc443c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc443c2 expref: 8 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.541632:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387b600, rc 0) 00000100:00100000:2.0:1787864894.542025:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+8:17060:x1874711844905216:12345-0@lo:101:mount.lustre.0 Request processed in 449us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.542031:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864894.542125:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.542141:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864894.542152:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443c9 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.542159:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc443c9 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.542207:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864894.542233:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.542303:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.542337:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905344 00000100:00100000:3.0:1787864894.542342:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905344 00000100:00100000:3.0:1787864894.542404:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787864894.542413:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+8:17060:x1874711844905344:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864894.542545:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17060:x1874711844905344:12345-0@lo:501:mount.lustre.0 Request processed in 134us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.542559:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864894.542632:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864894.542658:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787864894.542695:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.543064:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331000 going to sleep for 11 seconds 00000100:00100000:1.0:1787864894.543147:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905472 00000100:00100000:1.0:1787864894.543153:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905472 00000100:00100000:1.0:1787864894.543178:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787864894.543185:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17060:x1874711844905472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864894.543782:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17060:x1874711844905472:12345-0@lo:503:mount.lustre.0 Request processed in 596us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864894.543790:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864894.543930:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844905472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787864894.544390:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17099:1874711844905600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.544500:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.544532:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448331840 going to sleep for 11 seconds 00000100:00100000:1.0:1787864894.544585:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905600 00000100:00100000:1.0:1787864894.544590:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905600 00000100:00100000:1.0:1787864894.544733:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864894.544741:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17099:x1874711844905600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864894.545374:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17099:x1874711844905600:12345-0@lo:502:llog_process_th.0 Request processed in 632us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864894.545383:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864894.545467:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17099:1874711844905600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864894.545496:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864894.545508:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864894.545510:0:17099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787864894.545516:0:17099:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787864894.545519:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864894.545533:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff92754aaf3490) 00000020:00000080:0.0:1787864894.545548:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787864894.545552:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787864894.545636:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787864894.545642:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc443d7 00000020:00000080:0.0:1787864894.545823:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787864894.545828:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864894.545831:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864894.545833:0:17099:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787864894.545835:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864894.545838:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864894.545839:0:17099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787864894.545843:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864894.545857:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff927566f78000) 00000020:00000080:0.0:1787864894.545867:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787864894.545872:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787864894.545874:0:17099:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787864894.545877:0:17099:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787864894.545883:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787864894.545939:0:17099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754c99c000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787864894.545952:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff927566f79a48) 00000020:00000080:0.0:1787864894.545960:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787864894.546019:0:17099:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787864894.546025:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc443ec 00000020:00000080:0.0:1787864894.546113:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787864894.546119:0:17099:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787864894.546124:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2fcb8c294dc443f3 00080000:01000000:0.0:1787864894.546129:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787864894.546132:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc443fa 00010000:00010000:3.0:1787864894.614527:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787864894.615512:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1787864894.615780:0:17099:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787864894.616515:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff92757bc33490) 00000020:00000080:3.0:1787864894.616746:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787864894.616828:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787864894.616836:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc44408 00000020:00000080:3.0:1787864894.620125:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787864894.625181:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2fcb8c294dc4440f 00000020:00000080:2.0:1787864894.626140:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787864894.626153:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864894.626160:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.626162:0:17099:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787864894.626165:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787864894.626168:0:17099:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1787864894.626169:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864894.626171:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864894.626172:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787864894.626175:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.626176:0:17099:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787864894.626179:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864894.626184:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.626186:0:17099:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787864894.626191:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787864894.626230:0:17099:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787864894.626244:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864894.626247:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.626249:0:17099:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787864894.626251:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864894.626254:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.626265:0:17099:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1787864894.626270:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864894.626275:0:17099:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:00000080:2.0:1787864894.626301:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864894.626321:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff927448293490) 00000020:00000080:2.0:1787864894.626334:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787864894.626340:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864894.626392:0:17099:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1787864894.626397:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787864894.626402:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc4441d 00010000:00080000:2.0:1787864894.626441:0:17099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757bdbd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864894.628469:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787864894.630604:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787864894.630619:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787864894.630652:0:17099:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787864894.630748:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc44424 00000100:00080000:3.0:1787864894.631180:0:17099:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864894.631188:0:17099:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92757bdbd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864894.631225:0:17099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448bfe580 x1874711844905728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864894.631266:0:17099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1787864894.631360:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787864894.631427:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.631500:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844905728 00000100:00100000:1.0:1787864894.631506:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844905728 00000100:00100000:1.0:1787864894.631535:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864894.631541:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844905728:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787864894.631554:0:17086:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:3.0:1787864894.631833:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864894.631839:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864894.631842:0:17099:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787864894.631845:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787864894.631848:0:17099:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787864894.631850:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787864894.631852:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787864894.631853:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787864894.631856:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864894.631858:0:17099:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787864894.631860:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787864894.631871:0:17099:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787864894.631875:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864894.631876:0:17099:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787864894.631879:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787864894.631883:0:17099:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:3.0:1787864894.631922:0:17099:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787864894.631925:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787864894.631937:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92757bc34ed8) 00000020:00000080:3.0:1787864894.631951:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787864894.631956:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787864894.632021:0:17099:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787864894.632027:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787864894.632034:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc44432 00010000:00080000:3.0:1787864894.632061:0:17099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927573274000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864894.632286:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787864894.635415:0:17099:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787864894.635736:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787864894.638032:0:17099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864894.639239:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787864894.652151:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787864894.658440:0:17105:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787864894.658448:0:17105:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787864894.660016:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787864894.660031:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787864894.660067:0:17099:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787864894.660088:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc44439 00000100:00080000:2.0:1787864894.660098:0:17099:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864894.660105:0:17099:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff927573274000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864894.660143:0:17099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c7840 x1874711844905856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864894.660172:0:17099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787864894.660246:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864894.660250:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.660252:0:17099:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787864894.660270:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787864894.660274:0:17099:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787864894.660275:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864894.660277:0:17099:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864894.660278:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787864894.660281:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.660283:0:17099:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787864894.660286:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864894.660289:0:17099:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787864894.660300:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.660301:0:17099:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787864894.660304:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864894.660308:0:17099:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864894.660331:0:17099:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787864894.660334:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864894.660344:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff927448290000) 00000020:00000080:2.0:1787864894.660355:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787864894.660359:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787864894.660429:0:17099:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787864894.660435:0:17099:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787864894.660442:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2fcb8c294dc44447 00010000:00080000:2.0:1787864894.660471:0:17099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927446e01800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864894.660661:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787864894.660723:0:17099:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787864894.660738:0:17099:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787864894.660931:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905856:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787864894.660986:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844905856 offset 0 length 520: 4 00000040:00080000:2.0:1787864894.668229:0:17099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864894.668495:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787864894.668627:0:17099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787864894.669011:0:17107:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787864894.669016:0:17107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787864894.669564:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787864894.669574:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787864894.669604:0:17099:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787864894.669623:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc4444e 00000100:00080000:2.0:1787864894.669633:0:17099:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864894.669639:0:17099:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864894.669672:0:17099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c6580 x1874711844905984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864894.669702:0:17099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1787864894.669879:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905984:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787864894.669953:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844905984 offset 0 length 520: 4 00000100:00100000:0.0:1787864894.670189:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844905728:12345-0@lo:38:llog_process_th.0 Request processed in 38645us (38760us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787864894.670202:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787864894.670288:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864894.670294:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787864894.670298:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905728:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787864894.670507:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864894.670512:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.670514:0:17099:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787864894.670517:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864894.670521:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.670523:0:17099:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787864894.670525:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787864894.670527:0:17099:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787864894.670529:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864894.670531:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.670533:0:17099:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787864894.670535:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864894.670537:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864894.670538:0:17099:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787864894.670541:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787864894.670569:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17099:1874711844906112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864894.670607:0:17099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.670656:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.670689:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906112 00000100:00100000:3.0:1787864894.670694:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906112 00000100:00100000:3.0:1787864894.670749:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864894.670756:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17099:x1874711844906112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787864894.670871:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17099:x1874711844906112:12345-0@lo:502:llog_process_th.0 Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.670878:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864894.670967:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17099:1874711844906112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787864894.670985:0:17099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864894.670990:0:17099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864894.670991:0:17099:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787864894.670995:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787864894.671186:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787864894.671208:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787864894.671219:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443c9 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.671230:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5ba200/0x2fcb8c294dc443c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443c9 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864894.671237:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92754c99c000 from 1 10000000:01000000:1.0:1787864894.671240:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787864894.671273:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.671280:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.671289:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864894.671311:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787864894.671339:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.671471:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.671538:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906240 00000100:00100000:2.0:1787864894.671543:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906240 00000100:00100000:2.0:1787864894.671564:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864894.671570:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+9:17060:x1874711844906240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864894.671580:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864894.671593:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44455 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.671611:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 10 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.671620:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 10 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.671640:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387a000, rc 0) 00000100:00100000:2.0:1787864894.671678:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+10:17060:x1874711844906240:12345-0@lo:101:mount.lustre.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.671684:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787864894.671802:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787864894.671815:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.671823:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864894.672363:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906368:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787864894.672401:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.672417:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.672592:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906368 00000100:00100000:2.0:1787864894.672597:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906368 00000100:00100000:2.0:1787864894.672620:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864894.672626:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+10:17060:x1874711844906368:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787864894.672639:0:17073:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787864894.672645:0:17073:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787864894.672703:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+10:17060:x1874711844906368:12345-0@lo:256:mount.lustre.0 Request processed in 76us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.672711:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864894.672793:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906368:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787864894.673358:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787864894.673365:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.673374:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864894.673382:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92754c99c000 from 1 10000000:01000000:1.0:1787864894.673385:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864894.673407:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.673615:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.673625:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864894.673641:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787864894.673677:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.673730:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.673829:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906496 00000100:00100000:3.0:1787864894.673834:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906496 00000100:00100000:2.0:1787864894.673972:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864894.673981:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+10:17060:x1874711844906496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864894.673991:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864894.674003:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44463 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.674020:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.674030:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.674038:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387a400, rc 0) 00000100:00100000:2.0:1787864894.674079:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844906496:12345-0@lo:101:mount.lustre.0 Request processed in 100us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.674085:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864894.674150:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787864894.674160:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864894.674169:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864894.674216:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864894.674237:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.674269:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.674306:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906624 00000100:00100000:2.0:1787864894.674309:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906624 00000100:00100000:2.0:1787864894.674324:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864894.674329:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844906624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864894.674479:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844906624:12345-0@lo:501:mount.lustre.0 Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.674486:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787864894.674666:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864894.674691:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864894.674723:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.674829:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.674901:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906752 00000100:00100000:2.0:1787864894.674905:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906752 00000100:00100000:2.0:1787864894.674922:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864894.674927:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844906752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864894.674999:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844906752:12345-0@lo:503:mount.lustre.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.675005:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787864894.675068:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844906752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864894.675386:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17109:1874711844906880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864894.675420:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.675452:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568e98f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.675536:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844906880 00000100:00100000:2.0:1787864894.675540:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844906880 00000100:00100000:2.0:1787864894.675557:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864894.675562:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17109:x1874711844906880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787864894.676016:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17109:x1874711844906880:12345-0@lo:502:llog_process_th.0 Request processed in 452us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.676022:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864894.676099:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17109:1874711844906880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864894.676122:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864894.676131:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676133:0:17109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787864894.676141:0:17109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92754c99c000 00000020:00000080:1.0:1787864894.676143:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864894.676151:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864894.676153:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676155:0:17109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787864894.676158:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864894.676160:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676161:0:17109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787864894.676163:0:17109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92754c99c000 00000020:00000080:1.0:1787864894.676165:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864894.676216:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864894.676220:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676221:0:17109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787864894.676224:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864894.676226:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676228:0:17109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864894.676231:0:17109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92754c99c000 00000020:00000080:1.0:1787864894.676233:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864894.676250:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864894.676253:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676264:0:17109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864894.676267:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864894.676271:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676272:0:17109:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787864894.676275:0:17109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92754c99c000 00000020:00000080:1.0:1787864894.676277:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787864894.676321:0:17109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17109:1874711844907008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864894.676354:0:17109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.676378:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907008 00000100:00100000:1.0:1787864894.676381:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907008 00000100:00100000:1.0:1787864894.676400:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864894.676406:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17109:x1874711844907008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864894.676486:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17109:x1874711844907008:12345-0@lo:502:llog_process_th.0 Request processed in 79us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864894.676492:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864894.676525:0:17109:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568e98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864894.676537:0:17109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17109:1874711844907008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787864894.676552:0:17109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864894.676556:0:17109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864894.676557:0:17109:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787864894.676560:0:17109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787864894.686221:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787864894.686267:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864894.686288:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.686306:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864894.686365:0:17060:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787864894.686367:0:17060:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92754c99c000 10000000:01000000:2.0:1787864894.686370:0:17060:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92754c99c000 10000000:01000000:2.0:1787864894.686373:0:17060:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787864894.686378:0:17060:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92754c99c000 from 1 10000000:01000000:2.0:1787864894.686381:0:17060:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787864894.686415:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.686881:0:17060:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.687033:0:17060:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864894.687057:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787864894.687125:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.687524:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45000 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.689623:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907136 00000100:00100000:0.0:1787864894.689636:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907136 00000100:00100000:3.0:1787864894.694637:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787864894.694658:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17060:x1874711844907136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864894.694675:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864894.694693:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824ec00/0x2fcb8c294dc44478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44471 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.694720:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824ec00/0x2fcb8c294dc44478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44471 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.694732:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824ec00/0x2fcb8c294dc44478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44471 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.694741:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824ec00, rc 0) 00000100:00100000:3.0:1787864894.694829:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844907136:12345-0@lo:101:mount.lustre.0 Request processed in 179us (7704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.694836:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864894.695028:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864894.695047:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44478 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.695057:0:17060:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44478 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864894.695143:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864894.695176:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.695211:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.695846:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907264 00000100:00100000:3.0:1787864894.695853:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907264 00000100:00100000:3.0:1787864894.695918:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864894.695927:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844907264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864894.696058:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844907264:12345-0@lo:501:mount.lustre.0 Request processed in 132us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.696074:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864894.696544:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864894.696588:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864894.696632:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864894.696656:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45000 going to sleep for 11 seconds 00000100:00100000:3.0:1787864894.697245:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907392 00000100:00100000:3.0:1787864894.697251:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907392 00000100:00100000:3.0:1787864894.697299:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787864894.697307:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844907392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787864894.697408:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844907392:12345-0@lo:503:mount.lustre.0 Request processed in 102us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864894.697415:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864894.697847:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844907392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864894.699631:0:17114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787864894.699697:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864894.699740:0:17114:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.699848:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907520 00000100:00100000:0.0:1787864894.699854:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907520 00000100:00100000:0.0:1787864894.699918:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864894.699935:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.700045:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907520:12345-0@lo:502:llog_process_th.0 Request processed in 112us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.700053:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864894.700102:0:17114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907520:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787864894.700157:0:17114:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787864894.700172:0:17114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff927566f7b490) 00000020:00000080:0.0:1787864894.700189:0:17114:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787864894.700277:0:17114:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754c99c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787864894.700281:0:17114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92754c99c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787864894.700284:0:17114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92754c99c000 4 00010000:00080000:0.0:1787864894.700311:0:17114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927448229000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.136@tcp at head 00010000:00010000:0.0:1787864894.709707:0:17114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787864894.709925:0:17114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787864894.709965:0:17114:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787864894.709976:0:17114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2fcb8c294dc44486 00000100:00080000:0.0:1787864894.709987:0:17114:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787864894.709993:0:17114:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff927448229000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864894.710027:0:17114:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc152c0 x1874711844907648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864894.710071:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844907648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787864894.710137:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787864894.710192:0:17114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787864894.711120:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907648 00000100:00100000:3.0:1787864894.711128:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907648 00000100:00100000:3.0:1787864894.711164:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787864894.711171:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844907648:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787864894.711251:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3636:x1874711844907648:12345-0@lo:38:llog_process_th.0 Request processed in 79us (1113us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787864894.711270:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864894.715563:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864894.715577:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864894.715583:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787864894.715595:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844907648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787864894.715741:0:17114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.715812:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.715850:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907776 00000100:00100000:0.0:1787864894.715855:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907776 00000100:00100000:0.0:1787864894.715925:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864894.715934:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.716038:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907776:12345-0@lo:502:llog_process_th.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.716045:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864894.716107:0:17114:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566eb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.716119:0:17114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.716154:0:17114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.716183:0:17114:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.716203:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844907904 00000100:00100000:0.0:1787864894.716207:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844907904 00000100:00100000:0.0:1787864894.716228:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864894.716233:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787864894.716303:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17114:x1874711844907904:12345-0@lo:502:llog_process_th.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.716309:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864894.716338:0:17114:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566eb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.716349:0:17114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:af099440-ba6e-4600-a03b-1ca45ea8912e:17114:1874711844907904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787864894.716366:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1787864894.717522:0:17060:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787864894.717552:0:17060:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787864894.717572:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44478 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.717582:0:17060:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92755387b800/0x2fcb8c294dc44471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44478 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787864894.717627:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787864894.717629:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864894.717630:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864894.717631:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864894.717632:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864894.717633:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864894.717634:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864894.717635:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864894.717637:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864894.717639:0:17060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864894.717642:0:17060:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787864894.717644:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864894.717646:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864894.717646:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864894.717648:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864894.717649:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864894.717650:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864894.717651:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864894.717651:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864894.717652:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864894.717653:0:17060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864894.717673:0:17060:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787864894.717688:0:17060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844908032:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787864894.717741:0:17060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.717771:0:17060:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566eb5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864894.717797:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908032 00000100:00100000:0.0:1787864894.717802:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908032 00000100:00100000:0.0:1787864894.717845:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787864894.717853:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844908032:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787864894.717875:0:17075:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787864894.717905:0:17075:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787864894.721756:0:17075:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787864894.721774:0:17075:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787864894.722071:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17060:x1874711844908032:12345-0@lo:253:mount.lustre.0 Request processed in 4215us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.722081:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787864894.722142:0:17060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17060:1874711844908032:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787864894.722156:0:17060:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787864894.722160:0:17060:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787864894.722161:0:17060:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787864894.722162:0:17060:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864894.722164:0:17060:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864894.722165:0:17060:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864894.722167:0:17060:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864894.722168:0:17060:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787864894.722169:0:17060:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787864894.722171:0:17060:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864894.722173:0:17060:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787864894.722184:0:17060:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1787864894.724283:0:17097:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787864894.724291:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787864894.724313:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.724332:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.724340:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.724379:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864894.724408:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 11 pid: 17073 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864894.724422:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844908160:0@lo:104: 00000100:00100000:3.0:1787864894.724480:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864894.724522:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff927568edf480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864894.728381:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908160 00000100:00100000:2.0:1787864894.728393:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908160 00000100:00100000:2.0:1787864894.728448:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864894.728458:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844908160:12345-0@lo:104: 00010000:00010000:2.0:1787864894.728475:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.728563:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864894.728569:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844908160:12345-0@lo:104: Request processed in 113us (4088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864894.728576:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864894.728617:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844908160:0@lo:104: 00010000:00010000:2.0:1787864894.728638:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.728655:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864894.728668:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.728675:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864894.728679:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.728687:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864894.728693:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864894.728698:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864894.728737:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.728744:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787864894.729378:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1787864894.729411:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.729419:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d948200/0x2fcb8c294dc44455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4445c expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864894.729433:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864894.729435:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864894.729436:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864894.735431:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844908288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864894.735502:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864894.735658:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908288 00000100:00100000:0.0:1787864894.735664:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908288 00010000:00010000:0.0:1787864894.735699:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 12 pid: 17073 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.735740:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864894.735749:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:3640:x1874711844908288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864894.735774:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864894.735779:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 12 pid: 17073 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735802:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 12 pid: 17073 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735821:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387a000/0x2fcb8c294dc4445c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44455 expref: 12 pid: 17073 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735838:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735846:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787864894.735860:0:17066:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011569745s 00010000:00010000:0.0:1787864894.735864:0:17066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735871:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735877:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735884:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735917:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824e000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864894.735921:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735929:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735951:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.735962:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864894.735999:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:3640:x1874711844908288:12345-0@lo:103:ldlm_bl.0 Request processed in 251us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864894.736006:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787864894.736027:0:17097:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.736035:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864894.736041:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824e000/0x2fcb8c294dc4448d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864894.736073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844908288:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787864894.757586:0:17060:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787864894.758249:0:17060:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787864894.758631:0:17122:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787864894.758635:0:17122:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1787864894.758716:0:17123:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787864894.759285:0:17123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787864894.760519:0:17060:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787864894.764152:0:17123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787864894.764228:0:17123:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:1.0:1787864894.765810:0:17124:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff92757dbba940 x1874711844908416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864894.765823:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000040:01000000:2.0:1787864894.766716:0:17060:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787864894.766758:0:17060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787864894.767205:0:17060:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787864894.767213:0:17060:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787864894.767244:0:17060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864894.770875:0:17060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787864894.772599:0:17060:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787864894.772658:0:17060:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787864894.773800:0:17060:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1787864894.774545:0:17060:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1787864894.776654:0:17060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787864894.780860:0:17060:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787864894.780989:0:17060:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa20881653988 00100000:10000000:2.0:1787864894.780998:0:17060:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787864894.782074:0:17060:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787864894.782091:0:17060:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787864894.782110:0:17060:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787864894.782125:0:17060:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787864894.783141:0:17060:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864894.783356:0:17060:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864895.386646:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864895.773737:0:17117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787864895.773746:0:17117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787864895.774861:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000040:00080000:0.0:1787864895.778312:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787864895.778325:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1787864896.410288:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864896.410295:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92754c99c000 from 7 10000000:01000000:2.0:1787864896.410298:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864896.410338:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864896.410349:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864896.410360:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864896.410396:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844908544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864896.410462:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864896.410515:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864896.410641:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908544 00000100:00100000:1.0:1787864896.410657:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908544 00000100:00100000:1.0:1787864896.410721:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864896.410731:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+11:17078:x1874711844908544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864896.410744:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864896.410770:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44494 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864896.410795:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864896.410806:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864896.410816:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949a00, rc 0) 00000100:00100000:1.0:1787864896.410853:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17078:x1874711844908544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864896.410861:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787864896.413326:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864896.414311:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844908544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864896.414338:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864896.414352:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864896.414429:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844908672:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787864896.414491:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864896.414526:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864896.414588:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908672 00000100:00100000:1.0:1787864896.414594:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908672 00000100:00100000:1.0:1787864896.414643:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787864896.414661:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17078:x1874711844908672:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787864896.414679:0:17075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864896.414696:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864896.414699:0:17075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787864896.414799:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17078:x1874711844908672:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864896.414806:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864896.415701:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844908672:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787864896.415754:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787864896.415763:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864896.415772:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864896.793083:0:17117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787864896.793091:0:17117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864896.793237:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787864896.793285:0:17117:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787864896.793413:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1787864896.793514:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:2.0:1787864897.433019:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864897.817475:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:2.0:1787864898.458033:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787864898.824319:0:17366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787864898.843498:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:2.0:1787864899.485508:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787864899.627048:0:17418:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864899.627240:0:17418:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787864899.865743:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000100:00080000:2.0:1787864899.865803:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787864899.865808:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787864899.865812:0:36:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864899.865819:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1787864899.865824:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1787864899.865829:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844908800:0@lo:400:kworker.0 00000100:00080000:2.0:1787864899.865832:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92757bdbd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864899.865936:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864899.866035:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c5e00 x1874711844908928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864899.866068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864899.866072:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864899.866075:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864899.866078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864899.866080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787864899.866083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787864899.866084:0:36:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864899.866089:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff927448229000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864899.866103:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c4f00 x1874711844909056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864899.866272:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844908928:0@lo:38:kworker.0 00000100:00100000:0.0:1787864899.866350:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864899.866390:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844909056:0@lo:38:kworker.0 00000100:00100000:0.0:1787864899.866415:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864899.866635:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908800 00000100:00100000:1.0:1787864899.866641:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908800 00000100:00100000:1.0:1787864899.866694:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864899.866695:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909056 00000100:00100000:3.0:1787864899.866702:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909056 00000100:00100000:3.0:1787864899.866728:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787864899.866733:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844909056:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787864899.866757:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:3.0:1787864899.866790:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2fcb8c294dc444a2 00000004:00100000:3.0:1787864899.866804:0:17083:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787864899.866834:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:3640:x1874711844908800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864899.866881:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:3640:x1874711844908800:12345-0@lo:400:kworker.0 Request processed in 179us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864899.866904:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864899.866941:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844908800:0@lo:400:kworker.0 00000100:00100000:2.0:1787864899.867056:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908928 00000100:00100000:2.0:1787864899.867061:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908928 00000100:00100000:2.0:1787864899.867130:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787864899.867136:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874711844908928:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787864899.867148:0:17087:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787864899.867180:0:17083:0:(import.c:65:import_set_state_nolock()) ffff92744679c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864899.867244:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874711844909056:12345-0@lo:38:kworker.0 Request processed in 509us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864899.867253:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787864899.870009:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9274490c4f00 x1874711844909056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787864899.870029:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787864899.870038:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787864899.870043:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787864899.870046:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927448229000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787864899.870052:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874711844909056:0@lo:38:kworker.0 00000100:00100000:2.0:1787864899.877255:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3636:x1874711844908928:12345-0@lo:38:kworker.0 Request processed in 10111us (10897us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787864899.877269:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787864899.877840:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864899.877847:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787864899.877851:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844908928:0@lo:38:kworker.0 00000020:00000004:1.0:1787864900.251821:0:17468:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864900.252088:0:17468:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864900.505434:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864900.889462:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:2.0:1787864901.529042:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864901.914983:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:3.0:1787864902.556457:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864902.937041:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:1.0:1787864903.583203:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864903.960971:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00010000:00010000:3.0:1787864904.604272:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864904.986014:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864894/real 1787864894] req@ffff9274490c6580 x1874711844905984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864904.986054:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c6580 x1874711844905984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864904.986064:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864894/real 1787864894] req@ffff9274490c7840 x1874711844905856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864904.986075:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c7840 x1874711844905856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787864904.986092:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864904.986100:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787864904.986104:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905984:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787864904.986109:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927573274000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864904.986113:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787864904.986116:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844905856:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787864904.986284:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844909184:0@lo:400:kworker.0 00000100:00080000:0.0:1787864904.986330:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787864904.986334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787864904.986336:0:36:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864904.986342:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:0.0:1787864904.986347:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787864904.986366:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92757bdbd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864904.986389:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc15e00 x1874711844909312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787864904.986404:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864904.986407:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787864904.986409:0:36:0:(import.c:65:import_set_state_nolock()) ffff927573274000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864904.986412:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:0.0:1787864904.986414:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787864904.986417:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff927573274000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864904.986427:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc17c00 x1874711844909440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787864904.986434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864904.986437:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787864904.986439:0:36:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864904.986447:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:0.0:1787864904.986450:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787864904.986454:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864904.986465:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc14000 x1874711844909568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864904.986511:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844909696:0@lo:400:kworker.0 00000100:00100000:0.0:1787864904.986564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864904.986635:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909696 00000100:00100000:0.0:1787864904.986642:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909696 00000100:00100000:0.0:1787864904.986691:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864904.986699:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864904.986742:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844909696:12345-0@lo:400:kworker.0 Request processed in 43us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864904.986749:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787864904.986781:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92757dc17840 x1874711844909696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864904.986793:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844909696:0@lo:400:kworker.0 00000100:00100000:0.0:1787864904.986823:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000100:00100000:1.0:1787864904.987130:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864904.990392:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909184 00000100:00100000:2.0:1787864904.990403:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909184 00000100:00100000:2.0:1787864904.990455:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864904.990464:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:3637:x1874711844909184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864904.990555:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+12:3637:x1874711844909184:12345-0@lo:400:kworker.0 Request processed in 92us (3425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864904.990563:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787864904.990605:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909312:0@lo:38:kworker.0 00000100:00100000:2.0:1787864904.990644:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864904.990755:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909312 00000100:00100000:0.0:1787864904.990761:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909312 00000100:00100000:2.0:1787864904.990769:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909440:0@lo:8:kworker.0 00000100:00100000:0.0:1787864904.990785:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864904.990791:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844909312:12345-0@lo:38:kworker.0 00000400:00000100:2.0:1787864904.990804:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844909440 offset 0 length 520: 4 00010000:00020000:0.0:1787864904.990809:0:17086:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787864904.990831:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909568:0@lo:8:kworker.0 00000400:00000100:2.0:1787864904.990852:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844909568 offset 0 length 520: 4 00000100:00100000:1.0:1787864904.996304:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844909184:0@lo:400:kworker.0 00000100:00100000:0.0:1787864905.006075:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844909312:12345-0@lo:38:kworker.0 Request processed in 15275us (15424us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787864905.006099:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787864905.006120:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787864905.006127:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787864905.006133:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909312:0@lo:38:kworker.0 00010000:00010000:1.0:1787864905.627547:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787864905.776049:0:17813:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787864905.776053:0:17813:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787864905.776055:0:17813:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787864905.776168:0:17813:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9275777b0800 00000020:01000004:2.0:1787864905.776183:0:17813:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787864905.776194:0:17813:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787864905.776218:0:17813:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff927448291a48) 00000020:00000080:2.0:1787864905.776233:0:17813:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787864905.841707:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787864905.842132:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.844582:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.844815:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.845139:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.845303:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.845747:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.845961:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.846145:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.846302:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.846527:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.846725:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.847185:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787864905.847459:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787864905.849608:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.849864:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.850043:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.850211:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.850450:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.850655:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.850874:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.851122:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.851284:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.851503:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.851675:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.852081:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.852256:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.852501:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.852695:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.852955:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.853142:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.853332:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.853613:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.853789:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.854096:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.854275:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.854443:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.854677:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.854845:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.855052:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.855292:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.855588:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.855773:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787864905.855986:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.856632:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787864905.856829:0:17813:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00080000:01000000:1.0:1787864905.859162:0:17813:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787864905.859513:0:17813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787864905.859524:0:17813:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787864905.859535:0:17813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc444b0 00000020:01000004:1.0:1787864905.859541:0:17813:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787864905.859560:0:17813:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787864905.859571:0:17813:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787864905.859577:0:17813:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787864905.859603:0:17813:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787864905.859607:0:17813:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787864905.864323:0:17813:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787864905.864360:0:17813:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.136@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787864905.864365:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787864905.864367:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787864905.864368:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864905.864369:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864905.864370:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864905.864372:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864905.864373:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787864905.864375:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864905.864376:0:17813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864905.864379:0:17813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787864905.864381:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787864905.864382:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787864905.864383:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864905.864384:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864905.864385:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864905.864386:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864905.864392:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787864905.864393:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864905.864394:0:17813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864905.864419:0:17813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787864905.864438:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844909824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787864905.864506:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864905.864554:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1787864905.864609:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909824 00000100:00100000:1.0:1787864905.864616:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909824 00000100:00100000:1.0:1787864905.864667:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864905.864676:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17813:x1874711844909824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787864905.864724:0:17075:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787864905.864727:0:17075:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787864905.864734:0:17075:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787864905.865028:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17813:x1874711844909824:12345-0@lo:253:mount.lustre.0 Request processed in 353us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.865036:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864905.865130:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844909824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787864905.865138:0:17813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787864905.865140:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787864905.865142:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787864905.865143:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864905.865144:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864905.865145:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864905.865146:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864905.865147:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787864905.865148:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864905.865149:0:17813:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787864905.865165:0:17813:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9275777b0800 from lustre-MDT0001 10000000:01000000:2.0:1787864905.865190:0:17813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787864905.865192:0:17813:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787864905.865209:0:17813:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92754aaf1a48 local copy 00010000:00010000:2.0:1787864905.865218:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864905.865305:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844909952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864905.865333:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864905.865359:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864905.865399:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844909952 00000100:00100000:1.0:1787864905.865403:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844909952 00000100:00100000:1.0:1787864905.865433:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864905.865441:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17813:x1874711844909952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864905.865494:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17813:x1874711844909952:12345-0@lo:501:mount.lustre.0 Request processed in 54us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864905.865501:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787864905.865573:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844909952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787864905.865585:0:17813:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787864905.865603:0:17813:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787864905.865608:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.865617:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.865642:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9275777b0800 10000000:01000000:3.0:1787864905.865646:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787864905.865651:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92754aaf1a48 10000000:01000000:3.0:1787864905.865653:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787864905.865656:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92754aaf1a48 from 1 10000000:01000000:3.0:1787864905.865659:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787864905.865679:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.865687:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.865696:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.865719:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864905.865744:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.865765:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864905.865818:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910080 00000100:00100000:1.0:1787864905.865822:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910080 00000100:00100000:1.0:1787864905.865853:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864905.865859:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+12:17813:x1874711844910080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787864905.865868:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864905.865879:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949800/0x2fcb8c294dc444be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc444b7 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864905.865930:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949800/0x2fcb8c294dc444be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc444b7 expref: 13 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864905.865939:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949800/0x2fcb8c294dc444be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc444b7 expref: 13 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864905.865948:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949800, rc 0) 00000100:00100000:1.0:1787864905.865975:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+13:17813:x1874711844910080:12345-0@lo:101:mount.lustre.0 Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.865981:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787864905.866047:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864905.866059:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444be expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866067:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc444be expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.866081:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787864905.866097:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444be expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866105:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824e000/0x2fcb8c294dc444b7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444be expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.866112:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9275777b0800 10000000:01000000:3.0:1787864905.866115:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787864905.866118:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9275777b0800 from 1 10000000:01000000:3.0:1787864905.866120:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787864905.866133:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866139:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866146:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.866163:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864905.866187:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.866213:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864905.866277:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910208 00000100:00100000:2.0:1787864905.866281:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910208 00000100:00100000:2.0:1787864905.866309:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787864905.866317:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+13:17813:x1874711844910208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864905.866331:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864905.866340:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387a000/0x2fcb8c294dc444cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc444c5 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866354:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387a000/0x2fcb8c294dc444cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc444c5 expref: 14 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866362:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387a000/0x2fcb8c294dc444cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc444c5 expref: 14 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866367:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387a000, rc 0) 00000100:00100000:2.0:1787864905.866396:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+14:17813:x1874711844910208:12345-0@lo:101:mount.lustre.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864905.866401:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787864905.866495:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864905.866506:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444cc expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866512:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc444cc expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.866521:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787864905.866533:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444cc expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866540:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824e400/0x2fcb8c294dc444c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444cc expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.866546:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787864905.866550:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864905.866554:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9275777b0800 10000000:01000000:3.0:1787864905.866557:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787864905.866560:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1787864905.866561:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1787864905.866573:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866580:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.866593:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.866606:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864905.866630:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.866656:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864905.866722:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910336 00000100:00100000:2.0:1787864905.866726:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910336 00000100:00100000:2.0:1787864905.866753:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787864905.866760:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+14:17813:x1874711844910336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864905.866766:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864905.866774:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030a00/0x2fcb8c294dc444da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc444d3 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866787:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030a00/0x2fcb8c294dc444da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc444d3 expref: 15 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866795:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030a00/0x2fcb8c294dc444da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc444d3 expref: 15 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.866801:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030a00, rc 0) 00000100:00100000:2.0:1787864905.866841:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910336:12345-0@lo:101:mount.lustre.0 Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864905.866847:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864905.867131:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864905.867142:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444da expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.867151:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc444da expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864905.871008:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1787864905.871871:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864905.876980:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787864905.877030:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787864905.877045:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787864905.877059:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787864905.877073:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787864905.877085:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787864905.877097:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787864905.877112:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787864905.877124:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787864905.877137:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787864905.877151:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787864905.877164:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787864905.877176:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787864905.877188:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787864905.877614:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787864905.877628:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787864905.877640:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787864905.877708:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787864905.877722:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787864905.877734:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787864905.877747:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787864905.877760:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787864905.877773:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787864905.877803:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787864905.877810:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787864905.877925:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864905.877989:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.878029:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864905.878142:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910464 00000100:00100000:1.0:1787864905.878149:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910464 00000100:00100000:1.0:1787864905.878257:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787864905.878267:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864905.878413:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910464:12345-0@lo:501:mount.lustre.0 Request processed in 148us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.878421:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787864905.878493:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864905.878529:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787864905.878580:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.879389:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864905.879627:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910592 00000100:00100000:2.0:1787864905.879633:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910592 00000100:00100000:2.0:1787864905.879666:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864905.879674:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864905.880695:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910592:12345-0@lo:503:mount.lustre.0 Request processed in 1018us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864905.880705:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864905.880842:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910592:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787864905.881306:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864905.881616:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910720:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864905.881668:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.881704:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864905.881772:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910720 00000100:00100000:1.0:1787864905.881777:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910720 00000100:00100000:1.0:1787864905.881857:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864905.881866:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864905.882496:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910720:12345-0@lo:502:mount.lustre.0 Request processed in 630us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.882504:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787864905.882673:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864905.882844:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787864905.882872:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1787864905.882923:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1787864905.882950:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1787864905.882965:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1787864905.882978:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1787864905.882990:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1787864905.883002:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1787864905.883015:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1787864905.883029:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1787864905.883042:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1787864905.883057:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1787864905.883069:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1787864905.883082:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1787864905.883094:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1787864905.883106:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1787864905.883118:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1787864905.883130:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1787864905.883141:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1787864905.883153:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1787864905.883165:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1787864905.883177:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1787864905.883214:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1787864905.883229:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1787864905.883248:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1787864905.883261:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1787864905.883274:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1787864905.883286:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1787864905.883299:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1787864905.883313:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1787864905.883325:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1787864905.883337:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1787864905.883351:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1787864905.883377:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1787864905.883395:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1787864905.883409:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1787864905.883432:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1787864905.884089:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1787864905.884106:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1787864905.884119:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1787864905.884132:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1787864905.884146:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1787864905.884158:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1787864905.884170:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1787864905.884216:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910848:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864905.884277:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.884367:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.884530:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910848 00000100:00100000:0.0:1787864905.884595:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910848 00000100:00100000:0.0:1787864905.884642:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787864905.884652:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864905.884798:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844910848:12345-0@lo:502:mount.lustre.0 Request processed in 147us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.884806:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864905.884879:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844910848:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864905.885018:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1787864905.885028:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787864905.885671:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864905.885681:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864905.885684:0:17817:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787864905.885688:0:17817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787864905.885691:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864905.885703:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff927566f7ced8) 00000020:00000080:0.0:1787864905.885722:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787864905.885727:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787864905.885790:0:17817:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787864905.885797:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc444e8 00000020:00000080:0.0:1787864905.886135:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787864905.886140:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864905.886143:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864905.886145:0:17817:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787864905.886148:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864905.886152:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864905.886153:0:17817:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787864905.886156:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864905.886171:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9275721eced8) 00000020:00000080:0.0:1787864905.886181:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787864905.886188:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787864905.886189:0:17817:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787864905.886191:0:17817:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787864905.886207:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787864905.886264:0:17817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9275777b0800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787864905.886276:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9275721eb490) 00000020:00000080:0.0:1787864905.886285:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787864905.886428:0:17817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787864905.886435:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc444fd 00000020:00000080:0.0:1787864905.886525:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787864905.886532:0:17817:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787864905.886536:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2fcb8c294dc44504 00080000:01000000:0.0:1787864905.886541:0:17817:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787864905.886544:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc4450b 00010000:00010000:0.0:1787864905.962099:0:17817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1787864905.962717:0:17817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1787864905.964506:0:17817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787864905.971351:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787864905.971364:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.971377:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.971380:0:17817:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787864905.971384:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.971390:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.971391:0:17817:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787864905.971395:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787864905.971400:0:17817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:00000080:1.0:1787864905.971427:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864905.971442:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff927447fd0000) 00000020:00000080:1.0:1787864905.971462:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787864905.971468:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787864905.971552:0:17817:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787864905.971559:0:17817:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787864905.971642:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc44519 00010000:00080000:1.0:1787864905.971673:0:17817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927547dfd800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:1.0:1787864905.974245:0:17817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787864905.976155:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787864905.976170:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787864905.976370:0:17817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787864905.976391:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc44520 00000100:00080000:1.0:1787864905.976402:0:17817:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787864905.976408:0:17817:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff927547dfd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864905.976440:0:17817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbb9a40 x1874711844910976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864905.976467:0:17817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787864905.976551:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844910976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787864905.976619:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787864905.976726:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.976729:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976731:0:17817:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787864905.976734:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787864905.976736:0:17817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787864905.976738:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787864905.976745:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787864905.976747:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787864905.976749:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976750:0:17817:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787864905.976752:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.976756:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976758:0:17817:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787864905.976761:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787864905.976790:0:17817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787864905.976803:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.976806:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976807:0:17817:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787864905.976810:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787864905.976811:0:17817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787864905.976813:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787864905.976814:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787864905.976816:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787864905.976818:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976820:0:17817:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787864905.976822:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787864905.976825:0:17817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787864905.976829:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.976830:0:17817:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787864905.976833:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787864905.976836:0:17817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:1.0:1787864905.976855:0:17817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787864905.976857:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864905.976867:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff927447fd1a48) 00000020:00000080:1.0:1787864905.976878:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787864905.976882:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787864905.976953:0:17817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787864905.976960:0:17817:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787864905.976965:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc4452e 00010000:00080000:1.0:1787864905.976999:0:17817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927568d11000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:1.0:1787864905.977207:0:17817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787864905.977745:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844910976 00000100:00100000:0.0:1787864905.977753:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844910976 00000100:00100000:0.0:1787864905.977789:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864905.977796:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844910976:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787864905.977819:0:17086:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:0.0:1787864905.977845:0:17086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc44535 00000004:00100000:0.0:1787864905.977859:0:17086:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787864905.977865:0:17086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1787864905.978385:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844911104:0@lo:400:kworker.0 00000100:00100000:2.0:1787864905.978441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864905.978540:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844911104 00000100:00100000:1.0:1787864905.978545:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844911104 00000100:00100000:1.0:1787864905.978591:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864905.978598:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:3639:x1874711844911104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787864905.978667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787864905.978672:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787864905.978675:0:36:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787864905.978679:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1787864905.978683:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787864905.978687:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92757bdbd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864905.978706:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448bff0c0 x1874711844911232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864905.978722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864905.978725:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787864905.978728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864905.978731:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:01000000:0.0:1787864905.979128:0:17817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787864905.979167:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+15:3639:x1874711844911104:12345-0@lo:400:kworker.0 Request processed in 568us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.979175:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864905.979229:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844911360:0@lo:400:kworker.0 00000100:00100000:1.0:1787864905.979257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.979351:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844911232:0@lo:38:kworker.0 00000100:00100000:3.0:1787864905.979381:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864905.979425:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844911360 00000100:00100000:0.0:1787864905.979430:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844911360 00000100:00100000:0.0:1787864905.979465:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864905.979472:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844911360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864905.979516:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874711844911360:12345-0@lo:400:kworker.0 Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.979523:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864905.979560:0:17087:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1787864905.979568:0:17087:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000040:01000000:0.0:1787864905.979708:0:17817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1787864905.979737:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844911232 00000100:00100000:1.0:1787864905.979741:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844911232 00010000:00080000:1.0:1787864905.979785:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff927448bfcf00 x1874711844911360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864905.979799:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874711844911360:0@lo:400:kworker.0 00000100:00100000:3.0:1787864905.980154:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864905.980160:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844911232:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787864905.980225:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3636:x1874711844911232:12345-0@lo:38:kworker.0 Request processed in 64us (843us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787864905.980232:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864905.980287:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787864905.980293:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787864905.980297:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787864905.980300:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844911232:0@lo:38:kworker.0 00000100:00100000:2.0:1787864905.980385:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844911104:0@lo:400:kworker.0 00000040:00080000:0.0:1787864905.981290:0:17817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864905.981536:0:17817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787864905.981675:0:17817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:3.0:1787864905.982113:0:17823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787864905.982118:0:17823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787864905.983057:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787864905.983069:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787864905.983108:0:17817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787864905.983128:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc4453c 00000100:00080000:2.0:1787864905.983138:0:17817:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864905.983143:0:17817:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff927568d11000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864905.983182:0:17817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c5e00 x1874711844911488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864905.983246:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844911488:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787864905.983296:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844911488 offset 0 length 520: 4 00000100:00080000:2.0:1787864905.983347:0:17817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787864905.983421:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864905.983425:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.983435:0:17817:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787864905.983439:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787864905.983441:0:17817:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1787864905.983443:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864905.983444:0:17817:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787864905.983446:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787864905.983448:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.983449:0:17817:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787864905.983451:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787864905.983455:0:17817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787864905.983458:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.983460:0:17817:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787864905.983463:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787864905.983466:0:17817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.136@tcp to nid 0x20000c0a8ce88 (192.168.206.136@tcp) 00000020:01000000:2.0:1787864905.983485:0:17817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787864905.983487:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787864905.983498:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff92757bdf4ed8) 00000020:00000080:2.0:1787864905.983509:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787864905.983513:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1787864905.983541:0:17086:0:(import.c:65:import_set_state_nolock()) ffff92757de4d000 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1787864905.983640:0:17817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787864905.983650:0:17817:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787864905.983655:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2fcb8c294dc4454a 00010000:00080000:2.0:1787864905.983676:0:17817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92744822e800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864905.983868:0:17817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787864905.983948:0:17817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787864905.983961:0:17817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787864905.984114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864905.984118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864905.984121:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864905.984123:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787864905.984544:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844910976:12345-0@lo:38:llog_process_th.0 Request processed in 6745us (7922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864905.984562:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864905.984672:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864905.984683:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787864905.984690:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787864905.984695:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787864905.984697:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927547dfd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787864905.984717:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844910976:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787864905.984836:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864905.984848:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844911616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864905.984907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864905.984927:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844911616 00000100:00100000:0.0:1787864905.984932:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844911616 00000100:00100000:0.0:1787864905.985163:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864905.985173:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844911616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864905.985206:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787864905.985293:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874711844911616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.985300:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864905.985343:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844911616:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787864905.985822:0:17817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864905.986078:0:17817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787864905.986217:0:17817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787864905.986709:0:17825:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787864905.986714:0:17825:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787864905.987487:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787864905.987498:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787864905.987540:0:17817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787864905.987559:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc44551 00000100:00080000:2.0:1787864905.987639:0:17817:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864905.987645:0:17817:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff92744822e800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864905.987674:0:17817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c4f00 x1874711844911744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864905.987735:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844911744:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787864905.987784:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844911744 offset 0 length 520: 4 00000100:00080000:2.0:1787864905.987834:0:17817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787864905.987970:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864905.987974:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.987976:0:17817:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787864905.987979:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864905.987983:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.987985:0:17817:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787864905.987988:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787864905.987990:0:17817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787864905.987991:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864905.987993:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.987995:0:17817:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787864905.987997:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864905.987999:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.988000:0:17817:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787864905.988003:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787864905.988027:0:17817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864905.988030:0:17817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864905.988031:0:17817:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787864905.988034:0:17817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1787864905.988181:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864905.988186:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864905.988189:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864905.988192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787864905.988292:0:17813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787864905.988324:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787864905.988337:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444da expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.988353:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824ea00/0x2fcb8c294dc444d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc444da expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.988371:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9275777b0800 from 1 10000000:01000000:3.0:1787864905.988374:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787864905.988398:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.988405:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.988415:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.988429:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844911872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864905.988467:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.988493:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864905.988760:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844911872 00000100:00100000:2.0:1787864905.988767:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844911872 00000100:00100000:2.0:1787864905.988811:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787864905.988820:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+15:17813:x1874711844911872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864905.988831:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864905.988847:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44558 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.988867:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 16 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.988877:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 16 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864905.988886:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031c00, rc 0) 00000100:00100000:2.0:1787864905.988956:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17813:x1874711844911872:12345-0@lo:101:mount.lustre.0 Request processed in 136us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864905.988962:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864905.989102:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844911872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864905.989116:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.989125:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.989817:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912000:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787864905.989861:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.989924:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864905.990139:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912000 00000100:00100000:2.0:1787864905.990144:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912000 00000100:00100000:2.0:1787864905.990192:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787864905.990209:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17813:x1874711844912000:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787864905.990224:0:17075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787864905.990238:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787864905.990242:0:17075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787864905.990321:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17813:x1874711844912000:12345-0@lo:256:mount.lustre.0 Request processed in 110us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864905.990329:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787864905.990560:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787864905.991489:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787864905.991543:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.991554:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864905.991718:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9275777b0800 from 1 10000000:01000000:3.0:1787864905.991722:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787864905.991750:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.991768:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.991777:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864905.991796:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864905.991842:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.991882:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.992037:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912128 00000100:00100000:0.0:1787864905.992049:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912128 00000100:00100000:0.0:1787864905.992096:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864905.992104:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17813:x1874711844912128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864905.992114:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864905.992125:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44566 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864905.992145:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 17 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864905.992154:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 17 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864905.992173:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864905.992287:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912128:12345-0@lo:101:mount.lustre.0 Request processed in 184us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.992294:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787864905.992490:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864905.992504:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864905.992513:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864905.992719:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864905.992753:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864905.992793:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.992821:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.992878:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912256 00000100:00100000:0.0:1787864905.992882:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912256 00000100:00100000:0.0:1787864905.992933:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864905.992940:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864905.993013:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912256:12345-0@lo:501:mount.lustre.0 Request processed in 72us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.993019:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787864905.993297:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864905.993325:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787864905.993376:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864905.993402:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.993499:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912384 00000100:00100000:0.0:1787864905.993503:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912384 00000100:00100000:0.0:1787864905.993534:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787864905.993540:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787864905.993698:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912384:12345-0@lo:503:mount.lustre.0 Request processed in 157us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.993705:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864905.993798:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787864905.994139:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864905.994351:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864905.994454:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864905.994475:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756858f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.994548:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912512 00000100:00100000:0.0:1787864905.994552:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912512 00000100:00100000:0.0:1787864905.994654:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787864905.994661:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864905.994733:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912512:12345-0@lo:502:mount.lustre.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.994740:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787864905.994977:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787864905.995273:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787864905.995300:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787864905.995314:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787864905.995326:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787864905.995339:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787864905.995351:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787864905.995434:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787864905.995452:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787864905.995463:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787864905.995475:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787864905.995487:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787864905.995510:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864905.995548:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864905.995688:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756858f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864905.995866:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912640 00000100:00100000:0.0:1787864905.995871:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912640 00000100:00100000:0.0:1787864905.996081:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787864905.996091:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864905.996186:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912640:12345-0@lo:502:mount.lustre.0 Request processed in 97us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864905.996202:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787864905.996265:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787864905.996307:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787864905.996316:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787864905.996950:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.996960:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.996962:0:17827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787864905.996975:0:17827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9275777b0800 00000020:00000080:1.0:1787864905.996977:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864905.996985:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.996987:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.996989:0:17827:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787864905.996991:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.996993:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.996995:0:17827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787864905.996998:0:17827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9275777b0800 00000020:00000080:1.0:1787864905.997000:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864905.997046:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.997050:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.997051:0:17827:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787864905.997054:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.997056:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.997057:0:17827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864905.997061:0:17827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9275777b0800 00000020:00000080:1.0:1787864905.997063:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864905.997079:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.997082:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.997083:0:17827:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787864905.997085:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787864905.997087:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.997088:0:17827:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787864905.997092:0:17827:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9275777b0800 00000020:00000080:1.0:1787864905.997094:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787864905.997112:0:17827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787864905.997115:0:17827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864905.997116:0:17827:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787864905.997118:0:17827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1787864906.003095:0:17813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787864906.003146:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864906.003232:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.003246:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864906.003310:0:17813:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787864906.003313:0:17813:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9275777b0800 10000000:01000000:3.0:1787864906.003316:0:17813:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9275777b0800 10000000:01000000:3.0:1787864906.003320:0:17813:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864906.003326:0:17813:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9275777b0800 from 1 10000000:01000000:3.0:1787864906.003329:0:17813:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787864906.003377:0:17813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.003386:0:17813:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.003409:0:17813:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864906.003433:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864906.003499:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.003536:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912768 00000100:00100000:3.0:1787864906.003540:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912768 00000100:00100000:3.0:1787864906.008695:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787864906.008711:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844912768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864906.008732:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864906.008748:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc4457b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44574 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.009010:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc4457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44574 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.009023:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824fc00/0x2fcb8c294dc4457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44574 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.009032:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824fc00, rc 0) 00000100:00100000:3.0:1787864906.009098:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844912768:12345-0@lo:101:mount.lustre.0 Request processed in 392us (5599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.009105:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787864906.009231:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b05180 going to sleep for 11 seconds 00000100:00100000:3.0:1787864906.009255:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864906.009271:0:17813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4457b expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.009290:0:17813:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4457b expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864906.010347:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864906.012722:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000040:00080000:3.0:1787864906.013821:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787864906.014107:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864906.014297:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1787864906.014321:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1787864906.014335:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1787864906.014348:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1787864906.014360:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1787864906.014388:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1787864906.014400:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1787864906.014412:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1787864906.014424:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1787864906.014435:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1787864906.014448:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1787864906.014460:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1787864906.014472:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1787864906.014484:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1787864906.014496:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1787864906.014519:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1787864906.014534:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1787864906.014548:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1787864906.014561:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1787864906.018047:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1787864906.018065:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1787864906.018076:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1787864906.018087:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1787864906.018100:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1787864906.018111:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1787864906.018122:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1787864906.018148:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1787864906.018158:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1787864906.018178:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1787864906.018181:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787864906.018289:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864906.018355:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.019505:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864906.020523:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844912896 00000100:00100000:0.0:1787864906.020532:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844912896 00000100:00100000:0.0:1787864906.020656:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864906.020666:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844912896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864906.020884:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844912896:12345-0@lo:501:mount.lustre.0 Request processed in 220us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864906.020911:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787864906.021016:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844912896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864906.021060:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787864906.021105:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.021134:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864906.021694:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913024 00000100:00100000:2.0:1787864906.021700:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913024 00000100:00100000:2.0:1787864906.021740:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864906.021749:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864906.023692:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913024:12345-0@lo:503:mount.lustre.0 Request processed in 1938us (2579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.023712:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787864906.023965:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913024:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787864906.025694:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864906.025985:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864906.026060:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.026105:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913152 00000100:00100000:3.0:1787864906.026111:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913152 00000100:00100000:3.0:1787864906.026224:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787864906.026234:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864906.026328:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913152:12345-0@lo:502:mount.lustre.0 Request processed in 95us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.026335:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787864906.033511:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b05180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864906.033550:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864906.033811:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787864906.033839:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1787864906.033853:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1787864906.033865:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1787864906.033877:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1787864906.033910:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1787864906.033927:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1787864906.033939:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1787864906.033951:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1787864906.033964:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1787864906.033977:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1787864906.033992:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1787864906.034004:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1787864906.034017:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1787864906.034028:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1787864906.034040:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1787864906.034054:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1787864906.034067:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1787864906.034080:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1787864906.034092:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1787864906.034120:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1787864906.034135:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1787864906.034148:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1787864906.034161:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1787864906.034175:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1787864906.034185:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1787864906.034209:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1787864906.034225:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1787864906.034236:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1787864906.034247:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1787864906.034271:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1787864906.034284:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1787864906.034296:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1787864906.034307:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1787864906.034318:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1787864906.034332:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1787864906.034356:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1787864906.034386:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1787864906.034399:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1787864906.034412:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1787864906.034424:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1787864906.034435:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1787864906.034447:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1787864906.034457:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1787864906.034467:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1787864906.034477:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1787864906.034488:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1787864906.034499:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1787864906.034545:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864906.034619:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864906.034651:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864906.035133:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913280 00000100:00100000:2.0:1787864906.035139:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913280 00000100:00100000:2.0:1787864906.035182:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864906.035193:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913280:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864906.035315:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913280:12345-0@lo:502:mount.lustre.0 Request processed in 124us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.035323:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787864906.037002:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864906.037212:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1787864906.037236:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1787864906.037269:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864906.037329:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864906.037999:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566f9be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787864906.038245:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913408 00000100:00100000:3.0:1787864906.038251:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913408 00000100:00100000:3.0:1787864906.038302:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864906.038311:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913408:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864906.038442:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913408:12345-0@lo:502:mount.lustre.0 Request processed in 132us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.038450:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787864906.038673:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864906.038732:0:17813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1787864906.038747:0:17813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787864906.041752:0:17833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787864906.041838:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff92757bdf1a48) 00000020:00000080:2.0:1787864906.041861:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787864906.041974:0:17833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9275777b0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787864906.041978:0:17833:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9275777b0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787864906.041980:0:17833:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9275777b0800 3 00010000:00080000:2.0:1787864906.042010:0:17833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92754b00a000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864906.047343:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1787864906.048193:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1787864906.048248:0:17833:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787864906.048259:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2fcb8c294dc44589 00000100:00080000:2.0:1787864906.048269:0:17833:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864906.048275:0:17833:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92754b00a000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864906.048306:0:17833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c70c0 x1874711844913536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864906.048324:0:17833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787864906.048573:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844913536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787864906.048642:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.048698:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913536 00000100:00100000:3.0:1787864906.048705:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913536 00000100:00100000:3.0:1787864906.048740:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787864906.048747:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844913536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787864906.048911:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1787864906.048938:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2fcb8c294dc44590 00000004:00100000:3.0:1787864906.048952:0:17083:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787864906.048979:0:17083:0:(import.c:65:import_set_state_nolock()) ffff927545702000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864906.049024:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874711844913536:12345-0@lo:38:llog_process_th.0 Request processed in 276us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.049031:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787864906.049062:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9274490c70c0 x1874711844913536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864906.049072:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864906.049079:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787864906.049085:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787864906.049089:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787864906.049091:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92754b00a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787864906.049097:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874711844913536:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787864906.049269:0:17833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1787864906.049455:0:17813:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787864906.049490:0:17813:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864906.049504:0:17813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4457b expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864906.049516:0:17813:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824fa00/0x2fcb8c294dc44574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4457b expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787864906.049648:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787864906.049651:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787864906.049653:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864906.049654:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864906.049655:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864906.049657:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864906.049658:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864906.049660:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864906.049662:0:17813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864906.049665:0:17813:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787864906.049667:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864906.049669:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787864906.049670:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864906.049671:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864906.049672:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864906.049673:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864906.049674:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864906.049675:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864906.049676:0:17813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864906.049692:0:17813:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787864906.049707:0:17813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787864906.049745:0:17813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.050474:0:17813:0:(client.c:2715:ptlrpc_set_wait()) set ffff927547b05c00 going to sleep for 11 seconds 00000100:00080000:0.0:1787864906.050550:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864906.050555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864906.050558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864906.050570:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787864906.053675:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913664 00000100:00100000:2.0:1787864906.053687:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913664 00000100:00100000:2.0:1787864906.053745:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787864906.053754:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17813:x1874711844913664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787864906.053857:0:17073:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787864906.053869:0:17073:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787864906.057711:0:17061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787864906.057782:0:17073:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787864906.057800:0:17073:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787864906.057998:0:17097:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787864906.058003:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787864906.058025:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058043:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058051:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058058:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058091:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058105:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 18 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864906.058118:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844913792:0@lo:104: 00000100:00100000:2.0:1787864906.058175:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787864906.058230:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.058238:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864906.058256:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844913920:0@lo:104: 00000100:00100000:2.0:1787864906.058278:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864906.058304:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff927545934900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864906.058462:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913792 00000100:00100000:1.0:1787864906.058468:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913792 00000100:00100000:1.0:1787864906.058496:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844913920 00000100:00100000:1.0:1787864906.058504:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844913920 00000100:00100000:1.0:1787864906.058521:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864906.058529:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844913792:12345-0@lo:104: 00010000:00010000:1.0:1787864906.058539:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.058674:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864906.058680:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844913792:12345-0@lo:104: Request processed in 153us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.058688:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864906.058704:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864906.058710:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844913920:12345-0@lo:104: 00010000:00010000:1.0:1787864906.058717:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.058747:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864906.058751:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844913920:12345-0@lo:104: Request processed in 43us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.058851:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844913792:0@lo:104: 00000100:00100000:2.0:1787864906.058860:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844913920:0@lo:104: 00010000:00010000:2.0:1787864906.058878:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864906.058941:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787864906.058958:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864906.058965:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.058972:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824f600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864906.058976:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.058983:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864906.059000:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864906.059005:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864906.059040:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059047:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864906.059064:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059071:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824f600/0x2fcb8c294dc44558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4455f expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059083:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864906.059086:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059091:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864906.059094:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059101:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864906.059107:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864906.059112:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864906.059130:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059136:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864906.059150:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059156:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92755387a200/0x2fcb8c294dc44494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4449b expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059170:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864906.059171:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864906.059173:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864906.059179:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864906.059185:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864906.059207:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844914048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864906.059238:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.059266:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864906.059274:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844914176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864906.059297:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.059325:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914048 00000100:00100000:1.0:1787864906.059329:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914048 00010000:00010000:1.0:1787864906.059346:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 19 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864906.059377:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914176 00000100:00100000:1.0:1787864906.059380:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914176 00010000:00010000:1.0:1787864906.059392:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 20 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864906.059405:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864906.059419:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+20:3637:x1874711844914048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864906.059429:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864906.059434:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 20 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059444:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 20 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059456:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031c00/0x2fcb8c294dc4455f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44558 expref: 20 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059467:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864906.059493:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+19:3637:x1874711844914048:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.059499:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864906.059514:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864906.059521:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3640:x1874711844914176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864906.059528:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864906.059532:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059541:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059550:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc4449b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44494 expref: 18 pid: 17073 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.059560:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864906.059862:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17813:x1874711844913664:12345-0@lo:253:mount.lustre.0 Request processed in 6109us (10115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.059871:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787864906.059939:0:17813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:17813:1874711844913664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787864906.059949:0:17813:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787864906.059952:0:17813:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864906.059953:0:17813:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787864906.059954:0:17813:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864906.059956:0:17813:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864906.059957:0:17813:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864906.059958:0:17813:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864906.059959:0:17813:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787864906.059961:0:17813:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864906.059962:0:17813:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787864906.059973:0:17813:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787864906.060917:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787864906.060932:0:17066:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011569745s 00010000:00010000:1.0:1787864906.060938:0:17066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060945:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060953:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060960:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060966:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864906.060970:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060978:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.060996:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864906.061007:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864906.061052:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+16:3640:x1874711844914176:12345-0@lo:103:ldlm_bl.0 Request processed in 1531us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.061059:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864906.061109:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844914048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864906.061132:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844914176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864906.061675:0:17097:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.061684:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864906.061689:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc44597 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:3.0:1787864906.069983:0:17813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1787864906.070059:0:17838:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1787864906.070063:0:17838:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787864906.074951:0:17839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787864906.074978:0:17813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787864906.076824:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787864906.076968:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.076996:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864906.077262:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914304 00000100:00100000:2.0:1787864906.077268:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914304 00000100:00100000:2.0:1787864906.077310:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864906.077319:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787864906.077392:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.077399:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864906.077486:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914304:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1787864906.077510:0:17840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787864906.077531:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787864906.077557:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864906.077644:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864906.077678:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914432 00000100:00100000:2.0:1787864906.077681:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914432 00000100:00100000:2.0:1787864906.077706:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864906.077722:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914432:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787864906.078064:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914432:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 341us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864906.078071:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:0.0:1787864906.078323:0:17813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787864906.078361:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864906.078672:0:17839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787864906.081099:0:17813:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787864906.081117:0:17813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787864906.081206:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864906.082186:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787864906.082754:0:17813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787864906.082783:0:17813:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787864906.082858:0:17813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864906.084241:0:17839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787864906.084294:0:17839:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787864906.084478:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914432:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787864906.084576:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17840:1874711844914560:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787864906.084629:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.084659:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447159840 going to sleep for 11 seconds 00000100:00100000:1.0:1787864906.084773:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914560 00000100:00100000:1.0:1787864906.084780:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914560 00000100:00100000:1.0:1787864906.084819:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864906.084827:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1874711844914560:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787864906.084873:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17840:x1874711844914560:12345-0@lo:900:lod0001_rec0000.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864906.084879:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787864906.085023:0:17840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff927448bfc780 x1874711844914560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864922 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864906.085034:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17840:1874711844914560:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787864906.085080:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787864906.085108:0:17840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864906.085129:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914688 00000100:00100000:3.0:1787864906.085132:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914688 00000100:00100000:3.0:1787864906.085162:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787864906.085168:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787864906.085227:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17840:x1874711844914688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864906.085247:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787864906.085263:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447159cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864906.085274:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc780 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17840:1874711844914688:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787864906.085309:0:17840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787864906.086990:0:17813:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1787864906.088188:0:17840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787864906.088253:0:17840:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787864906.088257:0:17840:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1787864906.088668:0:17813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787864906.090727:0:17813:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787864906.090825:0:17813:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa20885553988 00100000:10000000:1.0:1787864906.090833:0:17813:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1787864906.091947:0:17813:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787864906.091972:0:17813:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787864906.091986:0:17813:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787864906.092011:0:17813:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1787864906.095115:0:17813:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864906.095601:0:17813:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864906.651039:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864907.037974:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000040:00080000:3.0:1787864907.097582:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787864907.481128:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787864907.481145:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9275777b0800 from 8 10000000:01000000:3.0:1787864907.481151:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787864907.481206:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864907.481217:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864907.481228:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864907.481261:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844914816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787864907.481331:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864907.481384:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864907.481549:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914816 00000100:00100000:1.0:1787864907.481556:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914816 00000100:00100000:1.0:1787864907.481611:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787864907.481621:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17078:x1874711844914816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864907.481634:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864907.481648:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4459e expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.481671:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 17 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.481681:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 17 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.481690:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948c00, rc 0) 00000100:00100000:1.0:1787864907.481739:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844914816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864907.481746:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864907.481884:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844914816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864907.481934:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864907.481943:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864907.481998:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844914944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787864907.482030:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864907.482051:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864907.482221:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844914944 00000100:00100000:1.0:1787864907.482226:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844914944 00000100:00100000:1.0:1787864907.482263:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864907.482272:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844914944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787864907.482286:0:17073:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864907.482303:0:17073:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864907.482306:0:17073:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787864907.482398:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844914944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864907.482417:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864907.482455:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844914944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787864907.482503:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787864907.482510:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.482518:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864907.484344:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787864907.484347:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92754c99c000 from 8 10000000:01000000:1.0:1787864907.484350:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787864907.484382:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.484391:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.484400:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864907.484421:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844915072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864907.484473:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864907.484506:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9600 going to sleep for 11 seconds 00000100:00100000:2.0:1787864907.484922:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915072 00000100:00100000:2.0:1787864907.484929:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915072 00000100:00100000:2.0:1787864907.484972:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787864907.484983:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844915072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864907.484995:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864907.485008:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc445ac expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864907.485029:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 18 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864907.485040:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 18 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864907.485056:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864907.485118:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844915072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864907.485125:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787864907.485863:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844915072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864907.485883:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864907.485914:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864907.485986:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844915200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787864907.486033:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864907.486075:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864907.486185:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915200 00000100:00100000:1.0:1787864907.486198:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915200 00000100:00100000:1.0:1787864907.486230:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864907.486238:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844915200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787864907.486273:0:17076:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864907.486287:0:17076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864907.486290:0:17076:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787864907.486379:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844915200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864907.486386:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787864907.486713:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844915200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787864907.486755:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787864907.486761:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864907.486781:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864907.673161:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864908.057587:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000040:00080000:2.0:1787864908.124987:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787864908.697121:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864909.081226:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000001:02000400:0.0:1787864909.616635:0:18083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787864909.723231:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864910.105011:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000020:00000004:1.0:1787864910.305084:0:18135:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864910.305290:0:18135:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864910.745244:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787864910.919106:0:18185:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864910.919304:0:18185:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787864911.129035:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 0 seconds 00000100:00100000:3.0:1787864911.129084:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844915328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864911.129161:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864911.130215:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787864911.130222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787864911.130226:0:8:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864911.130236:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92757bdbd800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864911.130264:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dbbb480 x1874711844915584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864911.130283:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864911.130287:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864911.130289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864911.130293:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864911.130307:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864911.130311:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864911.130314:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864911.130318:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787864911.130346:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915328 00000100:00100000:1.0:1787864911.130366:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844915456:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.130411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864911.130435:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864911.130441:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844915712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.130466:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864911.130492:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915456 00000100:00100000:1.0:1787864911.130497:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915456 00000100:00100000:3.0:1787864911.130498:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915328 00000100:00100000:3.0:1787864911.130544:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864911.130552:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844915328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864911.130583:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864911.130668:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787864911.130675:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3637:x1874711844915456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.130712:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3637:x1874711844915456:12345-0@lo:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.130740:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844915328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 187us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.130747:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864911.130771:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844915840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.130790:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787864911.130872:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864911.130977:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844915328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864911.130982:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915712 00000100:00100000:1.0:1787864911.130988:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915712 00000100:00100000:1.0:1787864911.131017:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915840 00000100:00100000:1.0:1787864911.131020:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915840 00000100:00100000:2.0:1787864911.131032:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864911.131050:0:17081:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787864911.131051:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844915712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.131060:0:17081:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787864911.131098:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844915712:12345-0@lo:400:kworker.0 Request processed in 51us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.131105:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787864911.131123:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864911.131129:0:17082:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787864911.131131:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844915840:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787864911.131202:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92757dbbbc00 x1874711844915840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864911.131214:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844915840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.131229:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844915584:0@lo:38:kworker.0 00000100:00100000:2.0:1787864911.131341:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844915840:12345-0@lo:400:kworker.0 Request processed in 211us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.131348:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864911.131590:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787864911.131645:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92757dbb9e00 x1874711844915712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864911.131657:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844915712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864911.131666:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844915456:0@lo:400:kworker.0 00000100:00100000:2.0:1787864911.131953:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915584 00000100:00100000:2.0:1787864911.131959:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915584 00000100:00100000:2.0:1787864911.131982:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787864911.131989:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3636:x1874711844915584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787864911.132011:0:17086:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1787864911.132045:0:17086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc445ba 00000004:00100000:2.0:1787864911.132058:0:17086:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787864911.132063:0:17086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787864911.142422:0:17086:0:(import.c:65:import_set_state_nolock()) ffff9274489de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864911.142574:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844915584:12345-0@lo:38:kworker.0 Request processed in 10582us (10982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.142585:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787864911.145745:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787864911.145759:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787864911.145774:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787864911.145777:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757bdbd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787864911.145845:0:3636:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000003517937): req@ffff92757dbba940 x1874711844908416/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864911.145870:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844915584:0@lo:38:kworker.0 00000100:00100000:3.0:1787864911.146387:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.146454:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471f3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864911.146778:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844908416 00000100:00100000:1.0:1787864911.146787:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844908416 00000100:00100000:1.0:1787864911.146841:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864911.146850:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844908416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787864911.146976:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844908416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 127us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864911.146984:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864911.147102:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864911.147116:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844915968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864911.147152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864911.147194:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844915968 00000100:00100000:2.0:1787864911.147198:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844915968 00000100:00100000:2.0:1787864911.147231:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864911.147237:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844915968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787864911.147257:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787864911.147294:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874711844915968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.147301:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864911.147336:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844915968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864911.147470:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17124:1874711844908416:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787864911.147503:0:17124:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787864911.147533:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17124:1874711844916096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787864911.147563:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864911.147594:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45840 going to sleep for 11 seconds 00000100:00100000:2.0:1787864911.147768:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916096 00000100:00100000:2.0:1787864911.147773:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916096 00000100:00100000:2.0:1787864911.147840:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864911.147848:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844916096:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787864911.147968:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844916096:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 120us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.147975:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864911.148033:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17124:1874711844916096:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787864911.148099:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17124:1874711844916224:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787864911.148122:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864911.150491:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916224 00000100:00100000:1.0:1787864911.150504:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916224 00000100:00100000:3.0:1787864911.150519:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864911.150552:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864911.150564:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844916224:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787864911.151215:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17124:1874711844916224:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787864911.151363:0:17124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787864911.151794:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17124:x1874711844916224:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 101us (2538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.151804:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000040:00080000:1.0:1787864911.155939:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787864911.156027:0:17124:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:1.0:1787864911.156032:0:17124:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000080:1.0:1787864911.702719:0:18234:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfbff18f0 20000000:00000080:1.0:1787864911.702744:0:18234:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92755e66c400 uarg=0000000000000000 20000000:01000000:1.0:1787864911.702795:0:18234:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787864911.702803:0:18234:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787864911.702809:0:18234:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787864911.703481:0:18235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787864911.703665:0:18234:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787864911.709628:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787864911.709660:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.709694:0:18234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.709713:0:18234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 17 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.709721:0:18234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.709764:0:18234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 17 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.709779:0:18234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 17 pid: 17076 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864911.709794:0:18234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18234:1874711844916352:0@lo:104: 00000100:00100000:1.0:1787864911.709854:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864911.709955:0:18234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864911.709966:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916352 00010000:00010000:1.0:1787864911.709967:0:18234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864911.709983:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916352 00000100:00100000:1.0:1787864911.709984:0:18234:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18234:1874711844916480:0@lo:104: 00000100:00100000:1.0:1787864911.710022:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864911.710046:0:18234:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755ed03840 going to sleep for 11 seconds 00000100:00100000:3.0:1787864911.710049:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916480 00000100:00100000:3.0:1787864911.710067:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916480 00000100:00100000:3.0:1787864911.710089:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864911.710099:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:18234:x1874711844916352:12345-0@lo:104: 00010000:00010000:3.0:1787864911.710117:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.710234:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787864911.710240:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:18234:x1874711844916352:12345-0@lo:104: Request processed in 143us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.710249:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787864911.710273:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787864911.710288:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:18234:x1874711844916480:12345-0@lo:104: 00000100:00100000:1.0:1787864911.710289:0:18234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18234:1874711844916352:0@lo:104: 00010000:00010000:3.0:1787864911.710310:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.710358:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787864911.710363:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:18234:x1874711844916480:12345-0@lo:104: Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864911.710369:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864911.710605:0:18234:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18234:1874711844916480:0@lo:104: 00010000:00010000:1.0:1787864911.710626:0:18234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.710715:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864911.710723:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.710731:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824fe00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864911.710735:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.710746:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864911.710753:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864911.710770:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787864911.710812:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.713004:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864911.713614:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864911.713649:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.713658:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824fe00/0x2fcb8c294dc44566 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4456d expref: -99 pid: 17813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.713673:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864911.713675:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864911.713677:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864911.713688:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864911.713708:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844916608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864911.713775:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864911.713834:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916608 00000100:00100000:2.0:1787864911.713840:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916608 00010000:00010000:2.0:1787864911.713874:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 18 pid: 17076 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864911.713936:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787864911.713948:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3638:x1874711844916608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864911.713962:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864911.713968:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 18 pid: 17076 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.713980:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 18 pid: 17076 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.714011:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92754c5bb000/0x2fcb8c294dc4456d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44566 expref: 18 pid: 17076 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864911.714027:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864911.714065:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:3638:x1874711844916608:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864911.714073:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864911.714199:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844916608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864911.714542:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864911.714546:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864911.714548:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864911.714698:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.714710:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:3.0:1787864911.714714:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.714725:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787864911.714732:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864911.714737:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787864911.714791:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.714799:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787864911.714828:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864911.714836:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949c00/0x2fcb8c294dc44463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4446a expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864911.714855:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787864911.714857:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864911.714862:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864911.714864:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864911.714876:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844916736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864911.714953:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864911.715037:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916736 00000100:00100000:0.0:1787864911.715045:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916736 00010000:00010000:0.0:1787864911.715382:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864911.716194:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864911.716211:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+17:3637:x1874711844916736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864911.716228:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864911.716236:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716251:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716269:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92755387a400/0x2fcb8c294dc4446a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44463 expref: 17 pid: 17073 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716289:0:17068:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716299:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716496:0:17068:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716506:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716513:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716538:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716545:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864911.716550:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716560:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716581:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864911.716594:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787864911.716631:0:18234:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.716647:0:18234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864911.716655:0:18234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948200/0x2fcb8c294dc445c1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864911.716689:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+16:3637:x1874711844916736:12345-0@lo:103:ldlm_bl.0 Request processed in 483us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864911.716701:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787864911.716861:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844916736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787864911.769581:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864912.793029:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787864913.562667:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864913.562675:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9275777b0800 from 13 10000000:01000000:1.0:1787864913.562679:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864913.562719:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.562730:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.562741:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864913.562766:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844916864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864913.562827:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864913.563001:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc703c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864913.563390:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916864 00000100:00100000:2.0:1787864913.563396:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916864 00000100:00100000:2.0:1787864913.563467:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787864913.563476:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+16:17078:x1874711844916864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864913.563489:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864913.563501:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc445c8 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.563611:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 17 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.563622:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 17 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.563631:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030e00, rc 0) 00000100:00100000:2.0:1787864913.563678:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844916864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864913.563684:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787864913.563744:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844916864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864913.563757:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864913.563772:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864913.563828:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844916992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864913.563854:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864913.563977:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bc45300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864913.564014:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844916992 00000100:00100000:1.0:1787864913.564018:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844916992 00000100:00100000:1.0:1787864913.564045:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787864913.564051:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844916992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864913.564144:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844916992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864913.564151:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787864913.564219:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844916992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864913.564257:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864913.564290:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864913.564309:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bc45300 going to sleep for 11 seconds 00000100:00100000:1.0:1787864913.564341:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917120 00000100:00100000:1.0:1787864913.564345:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917120 00000100:00100000:1.0:1787864913.564371:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787864913.564378:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844917120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864913.564439:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844917120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864913.564445:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787864913.564479:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787864913.565721:0:18348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787864913.566173:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787864913.566196:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864913.566205:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.566216:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864913.566226:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864913.566229:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92754c99c000 from 13 10000000:01000000:1.0:1787864913.566232:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864913.566259:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.566267:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.566284:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864913.566303:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864913.566355:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864913.566424:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864913.566474:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917248 00000100:00100000:2.0:1787864913.566485:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917248 00000100:00100000:2.0:1787864913.566553:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787864913.566562:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+17:17078:x1874711844917248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864913.566573:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864913.566584:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc445d6 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.566605:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.566615:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 18 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.566623:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:2.0:1787864913.566698:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844917248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864913.566705:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787864913.566778:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864913.566790:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864913.566799:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864913.566846:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864913.566871:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864913.567083:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757dc70540 going to sleep for 11 seconds 00000100:00100000:2.0:1787864913.567346:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917376 00000100:00100000:2.0:1787864913.567351:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917376 00000100:00100000:2.0:1787864913.567406:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864913.567414:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844917376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864913.567512:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844917376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864913.567520:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787864913.567553:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864913.567580:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864913.567619:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864913.567641:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff927545668d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864913.567653:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917504 00000100:00100000:2.0:1787864913.567656:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917504 00000100:00100000:2.0:1787864913.567672:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787864913.567678:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844917504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864913.567749:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:17078:x1874711844917504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864913.567756:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787864913.567791:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844917504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787864913.568792:0:18349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787864913.569425:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787864913.569446:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787864913.569455:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.569465:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864913.819034:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864914.852138:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864915.225019:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864905/real 1787864905] req@ffff9274490c4f00 x1874711844911744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864915.225058:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c4f00 x1874711844911744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864915.225069:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864905/real 1787864905] req@ffff9274490c5e00 x1874711844911488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864915 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864915.225081:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9274490c5e00 x1874711844911488/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864915 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787864915.225107:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92744822e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864915.225132:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787864915.225136:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844911744:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787864915.225175:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927568d11000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864915.225182:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787864915.225186:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844911488:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787864915.225272:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864915.225277:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864915.225280:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864915.225283:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864915.225324:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864915.225327:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787864915.225330:0:8:0:(import.c:65:import_set_state_nolock()) ffff927568d11000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864915.225342:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1787864915.225349:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864915.225356:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff927568d11000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864915.225376:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844917888:0@lo:400:kworker.0 00000100:00100000:1.0:1787864915.225382:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558996940 x1874711844918144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864915.225394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864915.225397:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787864915.225399:0:8:0:(import.c:65:import_set_state_nolock()) ffff92744822e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864915.225402:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1787864915.225405:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787864915.225408:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff92744822e800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864915.225416:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927558994780 x1874711844918272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787864915.225463:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864915.225507:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864915.225513:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844918016:0@lo:400:kworker.0 00000100:00100000:0.0:1787864915.225546:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864915.225551:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917888 00000100:00100000:1.0:1787864915.225560:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917888 00000100:00100000:0.0:1787864915.225594:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918016 00000100:00100000:0.0:1787864915.225597:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918016 00000100:00100000:1.0:1787864915.225609:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864915.225618:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844917888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864915.225622:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864915.225627:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844918016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864915.225699:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844917632:0@lo:400:kworker.0 00000100:00100000:3.0:1787864915.225755:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844917760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864915.226005:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844918016:12345-0@lo:400:kworker.0 Request processed in 376us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864915.226022:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864915.226065:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844918016:0@lo:400:kworker.0 00000100:00100000:2.0:1787864915.226402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864915.226443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844918400:0@lo:400:kworker.0 00000100:00100000:2.0:1787864915.226477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864915.228067:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917632 00000100:00100000:0.0:1787864915.228082:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917632 00000100:00100000:0.0:1787864915.228152:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787864915.228164:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3639:x1874711844917632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864915.228221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864915.228272:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844917760 00000100:00100000:3.0:1787864915.228276:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844917760 00000100:00100000:3.0:1787864915.228309:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787864915.228317:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844917760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864915.228396:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844917888:12345-0@lo:400:kworker.0 Request processed in 2775us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864915.228409:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864915.228909:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918400 00000100:00100000:1.0:1787864915.228915:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918400 00000100:00100000:1.0:1787864915.228950:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864915.228958:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864915.228987:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844917760:12345-0@lo:400:kworker.0 Request processed in 47us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864915.228998:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864915.229008:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844918400:12345-0@lo:400:kworker.0 Request processed in 50us (2529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864915.229035:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787864915.229043:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844918144:0@lo:8:kworker.0 00010000:00080000:1.0:1787864915.229082:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92757dbbb0c0 x1874711844917888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864915.229098:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844917888:0@lo:400:kworker.0 00010000:00080000:2.0:1787864915.229164:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558995a40 x1874711844918400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000100:3.0:1787864915.229176:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844918144 offset 0 length 520: 4 00000100:00100000:2.0:1787864915.229180:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844918400:0@lo:400:kworker.0 00000100:00100000:3.0:1787864915.229210:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844918272:0@lo:8:kworker.0 00000400:00000100:3.0:1787864915.229239:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874711844918272 offset 0 length 520: 4 00000100:00100000:3.0:1787864915.229270:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844917760:0@lo:400:kworker.0 00000100:00100000:0.0:1787864915.230624:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:3639:x1874711844917632:12345-0@lo:400:kworker.0 Request processed in 2455us (4214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864915.230638:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787864915.230743:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844917632:0@lo:400:kworker.0 00010000:00010000:1.0:1787864915.865264:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787864916.249972:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787864916.250104:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844918528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864916.250178:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864916.250234:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844918656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864916.250260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864916.250294:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918528 00000100:00100000:2.0:1787864916.250300:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918528 00000100:00100000:2.0:1787864916.252448:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918656 00000100:00100000:2.0:1787864916.252459:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918656 00000100:00100000:2.0:1787864916.252480:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864916.252488:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844918528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787864916.252521:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787864916.252592:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874711844918528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864916.252599:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864916.252615:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864916.252621:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844918656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864916.252637:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787864916.252671:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844918656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864916.252677:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787864916.253019:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844918656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864916.253056:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844918528:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787864916.768437:0:17814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:01000004:1.0:1787864916.873170:0:18584:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787864916.873175:0:18584:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787864916.873176:0:18584:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787864916.873296:0:18584:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92754b00f000 00000020:01000004:1.0:1787864916.873314:0:18584:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787864916.873330:0:18584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787864916.873345:0:18584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff927447fd4ed8) 00000020:00000080:1.0:1787864916.873362:0:18584:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1787864916.891999:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787864916.964355:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787864916.971076:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787864916.971684:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787864916.972374:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787864916.973286:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787864916.973901:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787864916.974301:0:18584:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787864916.976885:0:18584:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787864916.977540:0:18584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787864916.977558:0:18584:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787864916.977575:0:18584:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2fcb8c294dc445eb 00000020:01000004:1.0:1787864916.977584:0:18584:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787864916.977611:0:18584:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787864916.977616:0:18584:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787864916.977623:0:18584:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787864916.977629:0:18584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787864916.978836:0:18584:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff927447fd3490) 00000020:00000080:1.0:1787864916.978870:0:18584:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787864916.987182:0:18584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787864916.987425:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787864916.987434:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787864916.990770:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787864916.990783:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787864916.991272:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787864916.991287:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787864916.998754:0:18584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864916.999180:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864916.999187:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787864917.002737:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787864917.002750:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787864917.040620:0:18584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787864917.041472:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787864917.041479:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787864917.044271:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787864917.044287:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787864917.047689:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787864917.047707:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787864917.055132:0:18584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787864917.056632:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787864917.056642:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787864917.061606:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787864917.061627:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787864917.135481:0:18584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787864917.135690:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787864917.135696:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787864917.137472:0:18584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787864917.137491:0:18584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787864917.138374:0:18584:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787864917.138474:0:18584:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787864917.138481:0:18584:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787864917.177822:0:18584:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787864917.177926:0:18584:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.136@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787864917.177932:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787864917.177934:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787864917.177936:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864917.177937:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864917.177938:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864917.177940:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864917.177942:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787864917.177944:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864917.177945:0:18584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787864917.177949:0:18584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787864917.177952:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787864917.177953:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787864917.177954:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864917.177955:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864917.177956:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864917.177958:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864917.177959:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787864917.177960:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864917.177961:0:18584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787864917.178452:0:18584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787864917.178481:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844918784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787864917.178577:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.178749:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927566e45900 going to sleep for 11 seconds 00000100:00100000:2.0:1787864917.181781:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918784 00000100:00100000:2.0:1787864917.181798:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918784 00000100:00100000:2.0:1787864917.181910:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787864917.181922:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:18584:x1874711844918784:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787864917.181993:0:17075:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787864917.182006:0:17075:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787864917.182011:0:17075:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787864917.183516:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+18:18584:x1874711844918784:12345-0@lo:253:mount.lustre.0 Request processed in 1587us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.183532:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787864917.183643:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844918784:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787864917.183661:0:18584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787864917.183678:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787864917.183680:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787864917.183681:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864917.183683:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864917.183684:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864917.183685:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864917.183687:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787864917.183690:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864917.183691:0:18584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787864917.183717:0:18584:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92754b00f000 from lustre-OST0000 10000000:01000000:1.0:1787864917.183838:0:18584:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787864917.183842:0:18584:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787864917.183853:0:18584:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92754aaf1a48 local copy 00010000:00010000:1.0:1787864917.183866:0:18584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864917.187826:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844918912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864917.187944:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.188058:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864917.192132:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844918912 00000100:00100000:2.0:1787864917.192159:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844918912 00000100:00100000:2.0:1787864917.192494:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787864917.192508:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:18584:x1874711844918912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864917.192686:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+18:18584:x1874711844918912:12345-0@lo:501:mount.lustre.0 Request processed in 181us (4741us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864917.192694:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787864917.192823:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844918912:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787864917.192850:0:18584:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787864917.192878:0:18584:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787864917.192915:0:18584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.192950:0:18584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864917.192991:0:18584:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92754b00f000 10000000:01000000:0.0:1787864917.193008:0:18584:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787864917.193016:0:18584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787864917.193019:0:18584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864917.193024:0:18584:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787864917.193028:0:18584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787864917.193066:0:18584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.193076:0:18584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.193086:0:18584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864917.193109:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787864917.193168:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.198956:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.199409:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919040 00000100:00100000:1.0:1787864917.199421:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919040 00000100:00100000:1.0:1787864917.199492:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787864917.199502:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+18:18584:x1874711844919040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787864917.199523:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864917.199546:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948000/0x2fcb8c294dc44600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc445f9 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.199579:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948000/0x2fcb8c294dc44600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc445f9 expref: 19 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.199592:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948000/0x2fcb8c294dc44600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445f9 expref: 19 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.199602:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948000, rc 0) 00000100:00100000:1.0:1787864917.199679:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919040:12345-0@lo:101:mount.lustre.0 Request processed in 178us (6511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.199704:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787864917.199910:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864917.199931:0:18584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44600 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.199942:0:18584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44600 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864917.201521:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787864917.202422:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864917.207147:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787864917.207656:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787864917.207675:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787864917.207691:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787864917.207706:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787864917.207929:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787864917.207969:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787864917.207976:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787864917.208547:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864917.208633:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.208686:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927544dc5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.208712:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919168 00000100:00100000:0.0:1787864917.208718:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919168 00000100:00100000:0.0:1787864917.208912:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787864917.208922:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864917.209335:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919168:12345-0@lo:501:mount.lustre.0 Request processed in 412us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.209344:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787864917.209862:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864917.210103:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864917.210185:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.210328:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.210379:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919296 00000100:00100000:1.0:1787864917.210387:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919296 00000100:00100000:1.0:1787864917.210477:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787864917.210487:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864917.211708:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919296:12345-0@lo:503:mount.lustre.0 Request processed in 1214us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.211849:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864917.212069:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:2.0:1787864917.212867:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864917.214255:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864917.214365:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.214634:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.214715:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919424 00000100:00100000:1.0:1787864917.214732:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919424 00000100:00100000:1.0:1787864917.214796:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787864917.214806:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.215678:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919424:12345-0@lo:502:mount.lustre.0 Request processed in 867us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.215692:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787864917.215855:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787864917.218016:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787864917.218174:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787864917.218194:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787864917.218207:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787864917.218220:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787864917.218232:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787864917.218245:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787864917.218257:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787864917.218288:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787864917.218304:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787864917.218319:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787864917.218338:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787864917.218387:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864917.218467:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.218516:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.218557:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919552 00000100:00100000:1.0:1787864917.218571:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919552 00000100:00100000:1.0:1787864917.218646:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787864917.218657:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.218850:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919552:12345-0@lo:502:mount.lustre.0 Request processed in 194us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.218859:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787864917.219084:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864917.219197:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787864917.219210:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1787864917.220640:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787864917.220653:0:18601:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1787864917.220661:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.220664:0:18601:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787864917.220671:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787864917.220690:0:18601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9275721e8000) 00000020:00000080:0.0:1787864917.220924:0:18601:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787864917.220934:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787864917.221272:0:18601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754b00f000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787864917.221282:0:18601:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787864917.221366:0:18601:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2fcb8c294dc4460e 00010000:00010000:0.0:1787864917.227703:0:18601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787864917.228533:0:18601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1787864917.230865:0:18601:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787864917.236185:0:18601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787864917.236388:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864917.236398:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236400:0:18601:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787864917.236403:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787864917.236406:0:18601:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1787864917.236408:0:18601:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787864917.236410:0:18601:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787864917.236411:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787864917.236413:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236414:0:18601:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787864917.236416:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864917.236420:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236421:0:18601:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787864917.236424:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787864917.236426:0:18601:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787864917.236428:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864917.236430:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236431:0:18601:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787864917.236433:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787864917.236435:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236437:0:18601:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787864917.236440:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787864917.236481:0:18601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787864917.236483:0:18601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787864917.236485:0:18601:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787864917.236488:0:18601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787864917.242544:0:18584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787864917.242603:0:18584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787864917.242633:0:18584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44600 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864917.242648:0:18584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5bae00/0x2fcb8c294dc445f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44600 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864917.242657:0:18584:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92754b00f000 from 1 10000000:01000000:2.0:1787864917.242672:0:18584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864917.242829:0:18584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864917.242838:0:18584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864917.242851:0:18584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864917.243297:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787864917.243458:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.243514:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787864917.244856:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919680 00000100:00100000:3.0:1787864917.244870:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919680 00000100:00100000:3.0:1787864917.244957:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787864917.244970:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844919680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864917.244991:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864917.245024:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44615 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864917.245058:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 20 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864917.245071:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 20 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864917.245082:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824e200, rc 0) 00000100:00100000:3.0:1787864917.245166:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844919680:12345-0@lo:101:mount.lustre.0 Request processed in 199us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864917.245174:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787864917.245494:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864917.245513:0:18584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864917.245524:0:18584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864917.248025:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787864917.248406:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864917.248612:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787864917.248637:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787864917.248653:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787864917.248658:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787864917.248747:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864917.248821:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.248868:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.249381:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919808 00000100:00100000:0.0:1787864917.249400:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919808 00000100:00100000:0.0:1787864917.249459:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787864917.249469:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844919808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864917.249622:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844919808:12345-0@lo:501:mount.lustre.0 Request processed in 153us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.249630:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787864917.249851:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864917.249931:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864917.249974:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.250195:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.250462:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844919936 00000100:00100000:1.0:1787864917.250469:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844919936 00000100:00100000:1.0:1787864917.250514:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787864917.250524:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844919936:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864917.250634:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844919936:12345-0@lo:503:mount.lustre.0 Request processed in 111us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.250641:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787864917.250746:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844919936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787864917.251793:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864917.252468:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864917.252565:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.252667:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.254467:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920064 00000100:00100000:1.0:1787864917.254482:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920064 00000100:00100000:1.0:1787864917.254669:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787864917.254682:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844920064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.254919:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844920064:12345-0@lo:502:mount.lustre.0 Request processed in 239us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.254927:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787864917.255068:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864917.256216:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787864917.256267:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787864917.256295:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787864917.256322:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787864917.256338:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787864917.256353:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787864917.256367:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787864917.256509:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787864917.256532:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787864917.256544:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787864917.256556:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787864917.256605:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864917.256685:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864917.257175:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275457099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864917.257258:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920192 00000100:00100000:2.0:1787864917.257267:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920192 00000100:00100000:2.0:1787864917.257388:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787864917.257398:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844920192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864917.257530:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844920192:12345-0@lo:502:mount.lustre.0 Request processed in 134us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.257538:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787864917.257629:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864917.257696:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787864917.257706:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787864917.259130:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864917.259156:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.259159:0:18605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787864917.259167:0:18605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92754b00f000 00000020:00000080:3.0:1787864917.259170:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864917.259179:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864917.259181:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.259182:0:18605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787864917.259185:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864917.259187:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.259188:0:18605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787864917.259191:0:18605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92754b00f000 00000020:00000080:3.0:1787864917.259193:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864917.259332:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864917.259336:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.259337:0:18605:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787864917.259339:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864917.259348:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.259349:0:18605:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787864917.259353:0:18605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92754b00f000 00000020:00000080:3.0:1787864917.259355:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864917.261980:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864917.262070:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.262073:0:18605:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787864917.262078:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864917.262083:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.262084:0:18605:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787864917.262089:0:18605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92754b00f000 00000020:00000080:3.0:1787864917.262091:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787864917.262171:0:18605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864917.262174:0:18605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864917.262175:0:18605:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787864917.262179:0:18605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787864917.263868:0:18584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787864917.263943:0:18584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864917.263964:0:18584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.263978:0:18584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864917.264063:0:18584:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787864917.264067:0:18584:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92754b00f000 10000000:01000000:0.0:1787864917.264071:0:18584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92754b00f000 10000000:01000000:0.0:1787864917.264075:0:18584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864917.264082:0:18584:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92754b00f000 from 1 10000000:01000000:0.0:1787864917.264085:0:18584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864917.264129:0:18584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.264147:0:18584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.264160:0:18584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864917.264190:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787864917.264285:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.271517:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20180 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.272534:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920320 00000100:00100000:0.0:1787864917.272548:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920320 00000100:00100000:0.0:1787864917.272620:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787864917.272630:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:18584:x1874711844920320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864917.272652:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864917.272674:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5bbc00/0x2fcb8c294dc4462a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44623 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.272708:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5bbc00/0x2fcb8c294dc4462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44623 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.272721:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5bbc00/0x2fcb8c294dc4462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44623 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.272731:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bbc00, rc 0) 00000100:00100000:0.0:1787864917.272807:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920320:12345-0@lo:101:mount.lustre.0 Request processed in 178us (8522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.272813:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787864917.274487:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920320:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864917.274518:0:18584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4462a expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864917.274532:0:18584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4462a expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864917.278462:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787864917.278837:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787864917.281745:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787864917.281822:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787864917.281842:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787864917.281874:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787864917.281955:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787864917.281974:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787864917.281990:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787864917.282482:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787864917.282502:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787864917.282517:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787864917.282535:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787864917.282552:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787864917.282567:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787864917.282581:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787864917.282595:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787864917.282635:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787864917.282653:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787864917.282666:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787864917.282676:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787864917.282696:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787864917.282710:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787864917.282722:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787864917.282735:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787864917.282749:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787864917.282764:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787864917.282779:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787864917.282793:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787864917.282807:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787864917.282820:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787864917.282831:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787864917.282843:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787864917.282871:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787864917.282916:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787864917.282935:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787864917.282949:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787864917.282962:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787864917.282977:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787864917.285225:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787864917.285249:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787864917.286461:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864917.286546:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.286595:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bc45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.287118:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920448 00000100:00100000:0.0:1787864917.287127:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920448 00000100:00100000:0.0:1787864917.287195:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787864917.287206:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864917.288222:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920448:12345-0@lo:501:mount.lustre.0 Request processed in 1008us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.288236:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787864917.288499:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864917.288562:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864917.288622:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.288660:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bc45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.288796:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920576 00000100:00100000:0.0:1787864917.288803:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920576 00000100:00100000:0.0:1787864917.288918:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787864917.288929:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787864917.289058:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920576:12345-0@lo:503:mount.lustre.0 Request processed in 131us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.289065:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787864917.290723:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920576:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787864917.291400:0:18584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787864917.291593:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.291737:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.292114:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920704 00000100:00100000:0.0:1787864917.292129:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920704 00000100:00100000:0.0:1787864917.292204:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787864917.292215:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.292471:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.293191:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920704:12345-0@lo:502:mount.lustre.0 Request processed in 972us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.293205:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787864917.293541:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864917.293819:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787864917.293852:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787864917.293865:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787864917.293916:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787864917.293943:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787864917.293961:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787864917.293982:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787864917.294454:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787864917.294484:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787864917.294502:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787864917.294519:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787864917.294535:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787864917.294555:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787864917.294579:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787864917.294595:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787864917.294611:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787864917.294625:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787864917.294639:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787864917.294652:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787864917.294684:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787864917.294704:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787864917.294721:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787864917.294740:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787864917.294758:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787864917.294773:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787864917.294786:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787864917.294799:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787864917.294810:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787864917.294820:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787864917.294831:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787864917.294842:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787864917.294854:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787864917.294867:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787864917.294880:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787864917.294922:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787864917.294958:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787864917.294975:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787864917.296267:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787864917.296331:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787864917.296343:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787864917.296354:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787864917.296365:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787864917.296375:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787864917.297098:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787864917.297147:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787864917.297164:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787864917.297180:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787864917.297195:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787864917.297269:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864917.299130:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.299219:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.299318:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920832 00000100:00100000:1.0:1787864917.299331:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920832 00000100:00100000:1.0:1787864917.299479:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787864917.299491:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864917.299662:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920832:12345-0@lo:502:mount.lustre.0 Request processed in 173us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.299671:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787864917.299689:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864917.300068:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787864917.300103:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787864917.300523:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864917.300598:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.300641:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844920960 00000100:00100000:0.0:1787864917.300647:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844920960 00000100:00100000:0.0:1787864917.300700:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787864917.300710:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864917.300831:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844920960:12345-0@lo:502:mount.lustre.0 Request processed in 121us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.300838:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787864917.300881:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.300932:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844920960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864917.300992:0:18584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787864917.301607:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787864917.306543:0:18610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787864917.306568:0:18610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92757bc31a48) 00000020:00000080:3.0:1787864917.306599:0:18610:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787864917.306721:0:18610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754b00f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787864917.306726:0:18610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92754b00f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787864917.306729:0:18610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92754b00f000 3 00010000:00080000:3.0:1787864917.306767:0:18610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927548601800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.136@tcp at head 00010000:00010000:3.0:1787864917.312589:0:18610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787864917.313652:0:18610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787864917.313711:0:18610:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787864917.313728:0:18610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2fcb8c294dc44638 00000100:00080000:3.0:1787864917.313741:0:18610:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864917.313748:0:18610:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff927548601800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864917.313790:0:18610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448bfd2c0 x1874711844921088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864917.313853:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844921088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787864917.313977:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.314715:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921088 00000100:00100000:0.0:1787864917.314727:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921088 00000100:00100000:0.0:1787864917.314779:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864917.314788:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844921088:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787864917.314821:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1787864917.314860:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2fcb8c294dc4463f 00000004:00100000:0.0:1787864917.314881:0:17083:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864917.314938:0:17083:0:(import.c:65:import_set_state_nolock()) ffff927447c75000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864917.315454:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874711844921088:12345-0@lo:38:llog_process_th.0 Request processed in 664us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.315464:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787864917.316558:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927448bfd2c0 x1874711844921088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864917.316573:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864917.316585:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787864917.316594:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787864917.316602:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787864917.316606:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927548601800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787864917.316615:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3636:1874711844921088:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787864917.316677:0:18610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787864917.318103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864917.318111:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864917.318114:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864917.318117:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864917.318163:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864917.318166:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787864917.318168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864917.318171:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787864917.318287:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844921600:0@lo:400:kworker.0 00000100:00100000:3.0:1787864917.318533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.318725:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844921216:0@lo:400:kworker.0 00000100:00100000:2.0:1787864917.318771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.318834:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844921344:0@lo:400:kworker.0 00000100:00100000:2.0:1787864917.318909:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921216 00000100:00100000:2.0:1787864917.318918:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921216 00000100:00100000:3.0:1787864917.319082:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844921472:0@lo:400:kworker.0 00000100:00100000:3.0:1787864917.319121:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864917.319176:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921472 00000100:00100000:3.0:1787864917.319179:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921472 00000100:00100000:2.0:1787864917.319219:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864917.319232:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844921216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864917.319316:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844921216:12345-0@lo:400:kworker.0 Request processed in 86us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864917.319557:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864917.319566:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844921472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864917.319612:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844921472:12345-0@lo:400:kworker.0 Request processed in 48us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864917.319621:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864917.319665:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844921472:0@lo:400:kworker.0 00000100:00100000:0.0:1787864917.319822:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921600 00000100:00100000:0.0:1787864917.319828:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921600 00000100:00100000:0.0:1787864917.319864:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864917.319873:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844921600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864917.319933:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844921600:12345-0@lo:400:kworker.0 Request processed in 63us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.319939:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864917.321189:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864917.321274:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844921216:0@lo:400:kworker.0 00000100:00100000:2.0:1787864917.321324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864917.322186:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921344 00000100:00100000:2.0:1787864917.322198:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921344 00000100:00100000:2.0:1787864917.322253:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864917.322263:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844921344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864917.322355:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844921344:12345-0@lo:400:kworker.0 Request processed in 94us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864917.322362:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787864917.322530:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9275589970c0 x1874711844921344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864917.322545:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844921344:0@lo:400:kworker.0 00010000:00080000:1.0:1787864917.322627:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff927558995e00 x1874711844921600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864917.322647:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844921600:0@lo:400:kworker.0 00000020:01000004:2.0:1787864917.323176:0:18610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787864917.323531:0:18610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff92757bdf3490) 00000020:00000080:2.0:1787864917.323561:0:18610:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787864917.323866:0:18610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92754b00f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864917.323871:0:18610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92754b00f000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787864917.323874:0:18610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92754b00f000 3 00010000:00080000:2.0:1787864917.323938:0:18610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9274483d7800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864917.328372:0:18610:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787864917.328767:0:18610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787864917.328835:0:18610:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787864917.328852:0:18610:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2fcb8c294dc4464d 00000100:00080000:2.0:1787864917.328866:0:18610:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864917.328873:0:18610:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9274483d7800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864917.329131:0:18610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c6580 x1874711844921728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864917.329196:0:18610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787864917.329231:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864917.329236:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864917.329239:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864917.329243:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864917.329247:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864917.329250:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864917.329253:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864917.329255:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787864917.329348:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844921728:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787864917.329453:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864917.329530:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921728 00000100:00100000:0.0:1787864917.329538:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921728 00000100:00100000:0.0:1787864917.329588:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787864917.329597:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844921728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787864917.329641:0:17082:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1787864917.329681:0:17082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2fcb8c294dc44654 00000004:00100000:0.0:1787864917.329698:0:17082:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864917.329736:0:17082:0:(import.c:65:import_set_state_nolock()) ffff927447c74000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864917.329791:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874711844921728:12345-0@lo:38:llog_process_th.0 Request processed in 194us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864917.329799:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787864917.329836:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9274490c6580 x1874711844921728/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864917.329848:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864917.329857:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787864917.329865:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787864917.329869:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787864917.329871:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9274483d7800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864917.329877:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3636:1874711844921728:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787864917.331307:0:18610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1787864917.331574:0:18584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787864917.331613:0:18584:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787864917.331632:0:18584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4462a expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864917.331645:0:18584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5ba000/0x2fcb8c294dc44623 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4462a expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787864917.331741:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787864917.331744:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864917.331746:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864917.331748:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864917.331749:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864917.331752:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864917.331753:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864917.331756:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864917.331757:0:18584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864917.331762:0:18584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787864917.331765:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787864917.331767:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864917.331768:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864917.331769:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864917.331770:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864917.331772:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864917.331773:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864917.331774:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864917.331775:0:18584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787864917.331806:0:18584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787864917.331828:0:18584:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844921856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787864917.331935:0:18584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864917.331985:0:18584:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275490dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1787864917.333453:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921856 00000100:00100000:0.0:1787864917.333468:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921856 00000100:00100000:0.0:1787864917.333528:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787864917.333538:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:18584:x1874711844921856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787864917.333577:0:17073:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787864917.333596:0:17073:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787864917.341296:0:17073:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787864917.341699:0:17073:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787864917.342831:0:17097:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787864917.342843:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787864917.342879:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.342913:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 21 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.342922:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 21 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.342931:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.342980:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 21 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343001:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 21 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.343019:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844921984:0@lo:104: 00000100:00100000:1.0:1787864917.343091:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864917.343166:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 21 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343176:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 21 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.343185:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844922112:0@lo:104: 00000100:00100000:1.0:1787864917.343214:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.343232:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff927554d55780 going to sleep for 11 seconds 00000100:00100000:1.0:1787864917.343265:0:17065:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787864917.343283:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844921984 00000100:00100000:1.0:1787864917.343299:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844921984 00000100:00100000:1.0:1787864917.343339:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922112 00000100:00100000:1.0:1787864917.343343:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922112 00000100:00100000:1.0:1787864917.343360:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864917.343369:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844921984:12345-0@lo:104: 00010000:00010000:1.0:1787864917.343381:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343430:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787864917.343435:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844921984:12345-0@lo:104: Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.343443:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864917.343459:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864917.343465:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927576455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844922112:12345-0@lo:104: 00010000:00010000:1.0:1787864917.343473:0:17065:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343516:0:17065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787864917.343522:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927576455450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844922112:12345-0@lo:104: Request processed in 57us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.343529:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787864917.343581:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864917.343587:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343595:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864917.343599:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343619:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864917.343627:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864917.343633:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864917.343664:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343671:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864917.343691:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343698:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d948400/0x2fcb8c294dc445ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445b3 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343712:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864917.343716:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343722:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92744824ee00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:1.0:1787864917.343726:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343732:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787864917.343738:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864917.343751:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787864917.343766:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343772:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787864917.343787:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343794:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92744824ee00/0x2fcb8c294dc4459e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445a5 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.343806:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864917.343810:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864917.343812:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864917.343818:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864917.343832:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844922240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864917.343863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.343948:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844922368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864917.343977:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864917.344022:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922240 00000100:00100000:1.0:1787864917.344027:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922240 00010000:00010000:1.0:1787864917.344049:0:17067:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 22 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.344073:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922368 00000100:00100000:1.0:1787864917.344077:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922368 00010000:00010000:1.0:1787864917.344092:0:17067:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 23 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.344122:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864917.344131:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:3638:x1874711844922240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864917.344157:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864917.344165:0:17067:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 23 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344178:0:17067:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 23 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344196:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864917.344225:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:3638:x1874711844922240:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.344232:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864917.344249:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864917.344258:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927544a37850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:3639:x1874711844922368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864917.344269:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864917.344274:0:17067:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 22 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344286:0:17067:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 22 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344298:0:17067:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344305:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787864917.344327:0:17067:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011569745s 00010000:00010000:1.0:1787864917.344331:0:17067:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344339:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344345:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344351:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344356:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864917.344360:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344367:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344378:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344387:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864917.344416:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927544a37850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:3639:x1874711844922368:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.344422:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787864917.344476:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844922368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787864917.344517:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844922240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787864917.344564:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031200/0x2fcb8c294dc445b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc445ac expref: 21 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.344574:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844921984:0@lo:104: 00010000:00010000:1.0:1787864917.344584:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948c00/0x2fcb8c294dc445a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc4459e expref: 20 pid: 17075 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.344593:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9275589970c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844922112:0@lo:104: 00010000:00010000:1.0:1787864917.344610:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344617:0:17097:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344623:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864917.344628:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948800/0x2fcb8c294dc4465b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864917.351060:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+19:18584:x1874711844921856:12345-0@lo:253:mount.lustre.0 Request processed in 17350us (18951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864917.351075:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787864917.351318:0:18584:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:18584:1874711844921856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787864917.351341:0:18584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787864917.351357:0:18584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864917.351359:0:18584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787864917.351360:0:18584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864917.351362:0:18584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864917.351363:0:18584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864917.351364:0:18584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864917.351366:0:18584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864917.351368:0:18584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864917.351369:0:18584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787864917.351981:0:18584:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1787864917.357805:0:18584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787864917.366250:0:18584:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787864917.366263:0:18584:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787864917.366323:0:18584:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787864917.366419:0:18584:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787864917.366441:0:18584:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787864917.366477:0:18584:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1787864917.367726:0:18584:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864917.368030:0:18584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787864917.913103:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787864918.217859:0:18663:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864918.218460:0:18663:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1787864918.361522:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787864918.938252:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787864919.322236:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864919.322244:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9275777b0800 from 9 10000000:01000000:2.0:1787864919.322248:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864919.322295:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.322307:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.322318:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864919.322357:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864919.322432:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864919.322479:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864919.322510:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922496 00000100:00100000:1.0:1787864919.322517:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922496 00000100:00100000:1.0:1787864919.322574:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787864919.322595:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+19:17078:x1874711844922496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864919.322608:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864919.322621:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44662 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.322645:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 20 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.322654:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 20 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.322663:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d949200, rc 0) 00000100:00100000:1.0:1787864919.322702:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+20:17078:x1874711844922496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864919.322709:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787864919.322965:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864919.323058:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.323068:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864919.323702:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787864919.323759:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864919.323794:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864919.323828:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922624 00000100:00100000:1.0:1787864919.323834:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922624 00000100:00100000:1.0:1787864919.323873:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787864919.323880:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+20:17078:x1874711844922624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787864919.323935:0:17073:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864919.323950:0:17073:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864919.323953:0:17073:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787864919.324023:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+20:17078:x1874711844922624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864919.324030:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787864919.325522:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787864919.325603:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787864919.325611:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.325622:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864919.325632:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864919.325635:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92754c99c000 from 9 10000000:01000000:2.0:1787864919.325638:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864919.325667:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.325676:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.325685:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864919.325716:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864919.325769:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864919.325812:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754a66d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864919.325984:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922752 00000100:00100000:1.0:1787864919.325990:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922752 00000100:00100000:1.0:1787864919.326029:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787864919.326038:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:17078:x1874711844922752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864919.326056:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864919.326068:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44670 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.326089:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.326099:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.326108:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948600, rc 0) 00000100:00100000:1.0:1787864919.326164:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844922752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864919.326170:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787864919.326237:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864919.326250:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.326259:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864919.326314:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787864919.326355:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864919.326376:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787864919.326474:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844922880 00000100:00100000:1.0:1787864919.326479:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844922880 00000100:00100000:1.0:1787864919.326508:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787864919.326514:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844922880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787864919.326526:0:17075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787864919.326540:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787864919.326543:0:17075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787864919.326615:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844922880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864919.326623:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787864919.326652:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844922880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787864919.326694:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787864919.326701:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.326713:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864919.385658:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864904/real 1787864904] req@ffff92757dc17c00 x1874711844909440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864919.385690:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92757dc17c00 x1874711844909440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864919.385700:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864904/real 1787864904] req@ffff92757dc14000 x1874711844909568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864919.385711:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92757dc14000 x1874711844909568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787864919.385730:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927573274000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864919.385752:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787864919.385768:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909440:0@lo:8:kworker.0 00000100:00080000:0.0:1787864919.385774:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864919.385779:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787864919.385783:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844909568:0@lo:8:kworker.0 00000100:00080000:3.0:1787864919.385910:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864919.385915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787864919.385918:0:36:0:(import.c:65:import_set_state_nolock()) ffff927573274000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787864919.385922:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1787864919.385927:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787864919.385934:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff927573274000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864919.385956:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448187c00 x1874711844923136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864919.385980:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864919.385983:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787864919.385985:0:36:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787864919.385988:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 430 00000100:00080000:3.0:1787864919.385991:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787864919.385995:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864919.386006:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448184780 x1874711844923264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787864919.386036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864919.386040:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787864919.386043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787864919.386046:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787864919.386077:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844923392:0@lo:400:kworker.0 00000100:00100000:3.0:1787864919.386149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864919.386174:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844923904:0@lo:400:kworker.0 00000100:00100000:3.0:1787864919.386197:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864919.386219:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787864919.386225:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844923520:0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.386237:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844923648:0@lo:400:kworker.0 00000100:00100000:3.0:1787864919.386252:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864919.386281:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864919.386289:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923520 00000100:00100000:3.0:1787864919.386295:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923520 00000100:00100000:2.0:1787864919.386317:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787864919.386326:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844923008:0@lo:400:kworker.0 00000100:00100000:3.0:1787864919.386340:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864919.386351:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844923520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864919.386530:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923392 00000100:00100000:0.0:1787864919.386535:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923392 00000100:00100000:0.0:1787864919.386568:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923904 00000100:00100000:0.0:1787864919.386572:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923904 00000100:00100000:0.0:1787864919.386595:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923648 00000100:00100000:0.0:1787864919.386597:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923648 00000100:00100000:0.0:1787864919.386616:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864919.386622:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844923392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.393686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864919.393734:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844923392:12345-0@lo:400:kworker.0 Request processed in 7108us (7581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864919.393748:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864919.393755:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923008 00000100:00100000:2.0:1787864919.393764:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923008 00000100:00100000:0.0:1787864919.393796:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787864919.393801:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864919.393811:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844923904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.393813:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844923008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864919.394335:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844923904:12345-0@lo:400:kworker.0 Request processed in 526us (8135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864919.394343:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864919.394361:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864919.394369:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844923648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864919.394402:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844923648:12345-0@lo:400:kworker.0 Request processed in 35us (8123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864919.394409:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864919.394449:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844923136:0@lo:8:kworker.0 00000100:00100000:0.0:1787864919.394489:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864919.394529:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844923264:0@lo:8:kworker.0 00000100:00100000:0.0:1787864919.394555:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864919.394604:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923136 00000100:00100000:0.0:1787864919.394609:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923136 00000100:00100000:0.0:1787864919.394626:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923264 00000100:00100000:0.0:1787864919.394629:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923264 00000100:00100000:0.0:1787864919.394641:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864919.394646:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874711844923136:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787864919.394668:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844923008:12345-0@lo:400:kworker.0 Request processed in 857us (986us total) trans 0 rc 0/0 00010000:00080000:0.0:1787864919.394672:0:18589:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 444 last 0 00000100:00100000:2.0:1787864919.394680:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:00000080:0.0:1787864919.394705:0:18589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc4467e 00002000:00100000:0.0:1787864919.394726:0:18589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff927447c72800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00080000:2.0:1787864919.394729:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:0.0:1787864919.394733:0:18589:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787864919.394737:0:18589:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787864919.394776:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844923008:0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.394785:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448184b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844923776:0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.394814:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787864919.394841:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274481852c0 x1874711844923648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864919.394852:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844923648:0@lo:400:kworker.0 00010000:00080000:2.0:1787864919.394951:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448184000 x1874711844923392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864919.394975:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844923392:0@lo:400:kworker.0 00010000:00080000:2.0:1787864919.394996:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448184f00 x1874711844923904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864919.395005:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844923904:0@lo:400:kworker.0 00002000:00080000:0.0:1787864919.395069:0:18589:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864919.395092:0:18589:0:(import.c:65:import_set_state_nolock()) ffff927447c76000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864919.395143:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844923136:12345-0@lo:8:kworker.0 Request processed in 496us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864919.395150:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787864919.395162:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864919.395166:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874711844923264:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787864919.395188:0:18589:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787864919.395525:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448187c00 x1874711844923136/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864919.395534:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787864919.395540:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787864919.395548:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787864919.395553:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787864919.395556:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927573274000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787864919.395612:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787864919.395617:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448187c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844923136:0@lo:8:kworker.0 00000004:00080000:2.0:1787864919.395641:0:17105:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787864919.395702:0:17105:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444457812101ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787864919.395708:0:17105:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787864919.397912:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844923520:12345-0@lo:400:kworker.0 Request processed in 11557us (11654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864919.397926:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864919.397989:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844923776 00000100:00100000:1.0:1787864919.397997:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844923776 00000100:00100000:2.0:1787864919.398039:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844924032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864919.398049:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864919.398060:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844923776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.398099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864919.398138:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844923776:12345-0@lo:400:kworker.0 Request processed in 80us (3322us total) trans 0 rc 0/0 00000004:00080000:3.0:1787864919.398160:0:17106:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787864919.398419:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924032 00000100:00100000:2.0:1787864919.398423:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924032 00000100:00100000:3.0:1787864919.398835:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17106:1874711844924160:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787864919.398876:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864919.398923:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864919.400854:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844923520:0@lo:400:kworker.0 00000100:00100000:2.0:1787864919.401479:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787864919.401498:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844924032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864919.401529:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787864919.401844:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844924032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 353us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864919.401865:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787864919.402987:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448185e00 x1874711844924032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864919.403010:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448185e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844924032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864919.403364:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787864919.403429:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787864919.403436:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1787864919.403518:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864919.403524:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787864919.403711:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448184b40 x1874711844923776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864919.403723:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844923776:0@lo:400:kworker.0 00000100:00100000:1.0:1787864919.403762:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924160 00000100:00100000:1.0:1787864919.403769:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924160 00000100:00100000:1.0:1787864919.403863:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864919.403871:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17106:x1874711844924160:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787864919.405536:0:17061:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787864919.410317:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3636:x1874711844923264:12345-0@lo:8:kworker.0 Request processed in 15142us (15754us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787864919.410331:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787864919.410511:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864919.410516:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787864919.410520:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448184780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844923264:0@lo:8:kworker.0 00002000:00080000:1.0:1787864919.411439:0:18740:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787864919.411448:0:18740:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787864919.411454:0:18740:0:(ofd_dev.c:1495:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:1.0:1787864919.418029:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.418040:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418062:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.418066:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.418072:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418089:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418099:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418109:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418181:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864919.418520:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.418526:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418534:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.418537:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.418541:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418550:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418584:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.418591:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418707:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864919.418715:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418723:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.418727:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418736:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418755:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418763:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc44685 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418792:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.418796:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418802:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.418805:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418812:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418822:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.418830:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.418831:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.418833:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.420188:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.420198:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4468c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.420347:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.421280:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.421289:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421364:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.421369:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.421376:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421389:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421398:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421417:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421441:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864919.421567:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.421573:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.421582:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.421586:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.421605:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.421621:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.421628:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc44693 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.421644:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.421646:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.421647:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.421832:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.421838:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421848:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.421851:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.421855:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421864:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421872:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.421879:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423354:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864919.423386:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.423394:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.423403:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.423407:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.423417:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.423433:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.423455:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc4469a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.423482:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.423485:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.423486:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.423803:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.423809:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423824:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.423827:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.423832:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423842:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423849:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423855:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.423931:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864919.425491:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864919.425501:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.425511:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864919.425515:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.425524:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.425545:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864919.425552:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.425634:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.425637:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.425639:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.425999:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.426007:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426018:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.426022:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.426028:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426040:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426064:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426071:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426146:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864919.426502:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.426508:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426517:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.426520:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.426523:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426534:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426542:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.426548:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426593:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864919.426601:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426608:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.426612:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426620:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426653:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426661:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426676:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.426679:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426686:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.426689:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426697:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426706:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.426714:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.426716:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.426718:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.427856:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.427865:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.428515:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.428523:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.428535:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.428539:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.428545:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.428557:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.429396:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.429405:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.429472:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.429479:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.429487:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.429492:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.429501:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.429517:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.429525:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.429527:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.429529:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.430192:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.430199:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.430451:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.430954:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.430960:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.430973:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.430977:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.430982:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.430995:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431004:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431011:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431027:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787864919.431171:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.431178:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.431197:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.431201:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.431208:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.431222:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.431230:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc446bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.431246:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.431248:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.431249:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.431473:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.431480:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431488:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.431492:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.431502:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431511:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431519:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431527:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431545:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864919.431585:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.431591:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.431599:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.431602:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.431610:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.431621:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.431628:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc446c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.431652:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.431660:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.431662:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.431863:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.431869:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431878:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.431881:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.431885:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431964:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431973:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.431992:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432014:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864919.432337:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.432343:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432352:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.432355:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.432359:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432368:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432376:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432381:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.432401:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787864919.432581:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864919.432586:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432594:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.432598:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432606:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432622:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432629:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc446cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432653:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.432656:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432662:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.432665:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432672:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432682:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432689:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc446d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.432700:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.432702:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.432711:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.432952:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.433039:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.433045:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433059:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.433062:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.433066:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433075:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433083:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433091:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433146:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864919.433441:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.433448:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433456:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.433459:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.433463:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433470:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433488:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.433496:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433531:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787864919.433536:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433543:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.433547:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433609:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433624:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433701:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc446d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433720:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.433723:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433730:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.433733:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433740:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433751:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.433758:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.433760:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.433767:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.433824:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.433830:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc446e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.434163:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.434169:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.434177:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.434180:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.434185:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.434193:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.434202:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.434218:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.434360:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.434366:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.434374:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.434377:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.434385:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.434396:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.434403:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.434405:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.434406:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.434463:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.434467:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc446e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.435132:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.435139:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435149:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.435152:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.435157:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435167:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435175:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435183:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.435265:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.435271:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.435280:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.435283:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.435299:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.435312:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.435320:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.435322:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.435324:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.435420:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.435425:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000159f6c5a/0x2fcb8c294dc446ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.435845:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.435852:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435861:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.435864:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.435869:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435878:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435926:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.435936:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.436018:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.436024:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.436032:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.436036:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.436046:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.436070:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.436078:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.436080:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.436082:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.436157:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.436162:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc446f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.436488:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.436494:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.436504:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.436507:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.436511:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.436519:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.436527:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.436533:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.436740:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.436745:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.436753:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.436756:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.436764:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.436790:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.436799:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.436801:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.436803:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.436988:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.436993:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ffef7a8/0x2fcb8c294dc446fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.437312:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.437318:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.437335:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.437339:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.437343:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.437352:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.437360:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.437367:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437494:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.437500:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437508:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.437512:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437520:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437531:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437539:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.437540:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.437542:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.437879:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.437885:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8c7167/0x2fcb8c294dc44703 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.437946:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864919.438324:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.438331:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438340:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.438344:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.438348:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438368:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438377:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438383:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438433:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864919.438781:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.438788:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438797:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.438800:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.438805:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438813:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438821:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.438838:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438873:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864919.438879:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438914:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.438919:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438928:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438942:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438948:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4470a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438963:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.438966:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438983:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.438986:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.438994:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.439004:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.439012:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.439014:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.439015:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.439228:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.439234:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f27333e0/0x2fcb8c294dc44711 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.439619:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.439626:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.439706:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.439710:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.439715:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.439726:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.439734:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.439741:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.439782:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.439787:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.439801:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.439804:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.439812:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.439823:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.439832:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.439834:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.439835:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.439925:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.439929:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.440317:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.440323:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.440332:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.440335:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.440339:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.440349:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.440357:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.440364:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.440462:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.440468:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.440475:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.440478:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.440487:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.440497:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.440512:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.440513:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.440515:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.440717:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.440723:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b910e31/0x2fcb8c294dc4471f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.441136:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.441142:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.441152:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.441156:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.441160:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.441171:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.441178:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.441185:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.441239:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.441245:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.441252:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.441256:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.441264:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.441276:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.441301:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.441302:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.441304:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.441406:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.441411:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678d06a3/0x2fcb8c294dc44726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.442151:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.442159:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.442181:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.442184:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.442189:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.442200:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.442209:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.442215:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.442268:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.442275:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.442282:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.442286:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.442302:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.442315:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.442323:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.442325:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.442327:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.442528:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.442534:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037adf16f/0x2fcb8c294dc4472d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.443011:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.443017:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443027:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.443030:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.443035:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443056:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443065:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443071:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.443117:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.443132:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.443140:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.443144:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.443159:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.443171:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.443180:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.443182:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.443183:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.443248:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.443253:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a3ac56/0x2fcb8c294dc44734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.443581:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.443587:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443595:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.443598:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.443602:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443611:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443774:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.443784:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.443815:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864919.443820:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.443827:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864919.443830:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.443838:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.443849:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864919.443859:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.443860:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864919.443862:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.443986:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.443991:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235f01e6/0x2fcb8c294dc4473b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864919.445995:0:18740:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864919.446008:0:18740:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.446023:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=444s v=(0 0) 00010000:00010000:1.0:1787864919.446027:0:18740:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864919.446033:0:18740:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.446047:0:18740:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.446055:0:18740:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864919.446075:0:18740:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.446174:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864919.446181:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.446190:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864919.446195:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.446204:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.446221:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864919.446231:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.446232:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864919.446234:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864919.446345:0:18740:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787864919.446350:0:18740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007747ee5a/0x2fcb8c294dc44742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18740 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787864919.446431:0:18740:0:(ofd_dev.c:1522:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1787864919.446571:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17106:x1874711844924160:12345-0@lo:5:osp-pre-0-0.0 Request processed in 42696us (47691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864919.446581:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787864919.447376:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864919.448791:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17106:1874711844924160:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787864919.448810:0:17106:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1787864919.448860:0:17106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17106:1874711844924288:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787864919.449422:0:17106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864919.449513:0:17106:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864919.451920:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924288 00000100:00100000:1.0:1787864919.451933:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924288 00000100:00100000:0.0:1787864919.454666:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864919.454681:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17106:x1874711844924288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787864919.454727:0:18590:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1787864919.467828:0:18585:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787864919.467964:0:18585:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787864919.473446:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17106:x1874711844924288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18761us (24018us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787864919.473477:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787864919.473572:0:17106:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787864919.473581:0:17106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17106:1874711844924288:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787864919.473596:0:17106:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1787864919.965173:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864920.986434:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864921.369443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844924416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864921.369513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864921.369563:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844924544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864921.369596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864921.369630:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924416 00000100:00100000:2.0:1787864921.369636:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924416 00000100:00100000:2.0:1787864921.369672:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924544 00000100:00100000:2.0:1787864921.369675:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924544 00000100:00100000:2.0:1787864921.369688:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864921.369696:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844924416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787864921.369724:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787864921.370356:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787864921.370366:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844924544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864921.370387:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787864921.370433:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844924544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864921.370440:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787864921.370630:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844924416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 934us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864921.370637:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864921.370678:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844924544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864921.370803:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844924416:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787864922.009003:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787864922.574733:0:18953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787864923.033136:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787864923.357875:0:19005:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864923.358789:0:19005:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864924.058646:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787864924.154508:0:19056:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864924.154720:0:19056:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1787864924.443878:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864924.443884:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787864924.443904:0:8:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787864924.443912:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:2.0:1787864924.443926:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787864924.443933:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864924.443955:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274490c7480 x1874711844925056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787864924.443983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864924.443987:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787864924.443990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787864924.444006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787864924.444046:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844924928:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864924.444263:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844925568:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444289:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864924.444312:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787864924.444318:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844925184:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864924.444352:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844925696:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864924.444398:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925568 00000100:00100000:2.0:1787864924.444404:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925568 00000100:00100000:2.0:1787864924.444446:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925184 00000100:00100000:2.0:1787864924.444449:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925184 00000100:00100000:2.0:1787864924.444460:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925696 00000100:00100000:2.0:1787864924.444462:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925696 00000100:00100000:2.0:1787864924.444476:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864924.444483:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844925568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444526:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844925568:12345-0@lo:400:kworker.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864924.444534:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787864924.444549:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864924.444555:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844925184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444578:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844925184:12345-0@lo:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864924.444584:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864924.444602:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864924.444608:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844925696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.444632:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844925696:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864924.444638:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787864924.444669:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92754cf830c0 x1874711844925184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864924.444682:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844925184:0@lo:400:kworker.0 00010000:00080000:2.0:1787864924.444698:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448a961c0 x1874711844925696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864924.444706:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844925696:0@lo:400:kworker.0 00010000:00080000:2.0:1787864924.444717:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448a95680 x1874711844925568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864924.444725:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a95680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844925568:0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.444881:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844924800:0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.444957:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864924.444979:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844925440:0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.444998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864924.445014:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787864924.445020:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844924672:0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.445041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864924.445066:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844925312:0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.445086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864924.445117:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925440 00000100:00100000:1.0:1787864924.445121:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925440 00000100:00100000:1.0:1787864924.445145:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787864924.445151:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844925440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.445182:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844925440:12345-0@lo:400:kworker.0 Request processed in 30us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864924.445188:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787864924.445202:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864924.445205:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864924.445213:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924672 00000100:00100000:1.0:1787864924.445217:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924672 00000100:00100000:1.0:1787864924.445237:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787864924.445244:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:3638:x1874711844924672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.445271:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:3638:x1874711844924672:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864924.445278:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787864924.445309:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844924672:0@lo:400:kworker.0 00010000:00080000:1.0:1787864924.445319:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448a97480 x1874711844925440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864924.445329:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844925440:0@lo:400:kworker.0 00000100:00100000:3.0:1787864924.445460:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844925056:0@lo:8:kworker.0 00000100:00100000:3.0:1787864924.445493:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864924.446056:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924928 00000100:00100000:1.0:1787864924.446061:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924928 00000100:00100000:1.0:1787864924.446115:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925056 00000100:00100000:1.0:1787864924.446118:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925056 00000100:00100000:1.0:1787864924.446133:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864924.446149:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844924928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864924.446189:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844924928:12345-0@lo:400:kworker.0 Request processed in 43us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864924.446196:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787864924.446208:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864924.446212:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1874711844925056:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787864924.446230:0:18740:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1787864924.447038:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864924.449434:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844924800 00000100:00100000:3.0:1787864924.449446:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844924800 00000100:00100000:3.0:1787864924.449509:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925312 00000100:00100000:3.0:1787864924.449513:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925312 00000100:00100000:3.0:1787864924.449543:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864924.449552:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844924800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864924.449649:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558996580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844924800:12345-0@lo:400:kworker.0 Request processed in 97us (4691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864924.449657:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864924.449675:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864924.449681:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844925312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864924.449712:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844925312:12345-0@lo:400:kworker.0 Request processed in 32us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864924.449719:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787864924.449911:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844924928:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.450122:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a95e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844925312:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.450133:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844924800:0@lo:400:kworker.0 00000100:00100000:2.0:1787864924.452161:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864924.452182:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844925824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787864924.452248:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864924.456075:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925824 00000100:00100000:0.0:1787864924.456087:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925824 00000100:00100000:0.0:1787864924.456159:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864924.456168:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844925824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864924.456197:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864924.456288:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844925824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864924.456296:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864924.456351:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844925824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864924.467609:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1874711844925056:12345-0@lo:8:kworker.0 Request processed in 21387us (22107us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787864924.467623:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787864924.468768:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864924.468776:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787864924.468780:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844925056:0@lo:8:kworker.0 00010000:00010000:1.0:1787864925.085241:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864926.105423:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864926.489491:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844925952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864926.489669:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787864926.489685:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844926080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864926.489721:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864926.489785:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844925952 00000100:00100000:3.0:1787864926.489792:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844925952 00000100:00100000:3.0:1787864926.489838:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864926.489847:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844925952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864926.489877:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000040:00080000:0.0:1787864926.491187:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787864926.491809:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864926.491976:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844925952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2129us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864926.491987:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787864926.492007:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926080 00000100:00100000:3.0:1787864926.492012:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926080 00000100:00100000:1.0:1787864926.492113:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844925952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864926.492236:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787864926.492247:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844926080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787864926.492288:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787864926.492444:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558997c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844926080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864926.492451:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864926.494001:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844926080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787864927.129193:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864928.153129:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864928.601490:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787864929.177113:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787864929.403731:0:19400:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787864929.403735:0:19400:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787864929.403736:0:19400:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787864929.403859:0:19400:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92755fbeb800 00000020:01000004:3.0:1787864929.403874:0:19400:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787864929.403919:0:19400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787864929.403947:0:19400:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92757bc30000) 00000020:00000080:3.0:1787864929.403965:0:19400:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787864929.492471:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787864929.496044:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787864929.496293:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787864929.497093:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787864929.497309:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787864929.497801:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787864929.498950:0:19400:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1787864929.503248:0:19400:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787864929.503473:0:19400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787864929.503486:0:19400:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787864929.503497:0:19400:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2fcb8c294dc44750 00000020:01000004:3.0:1787864929.503504:0:19400:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787864929.503525:0:19400:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.136@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787864929.503529:0:19400:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.136@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787864929.503552:0:19400:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787864929.503581:0:19400:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787864929.503585:0:19400:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.136@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787864929.527281:0:19400:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.136@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787864929.527317:0:19400:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.136@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787864929.527322:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787864929.527323:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864929.527325:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864929.527326:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864929.527327:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864929.527328:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864929.527330:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864929.527331:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864929.527332:0:19400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864929.527335:0:19400:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787864929.527337:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787864929.527339:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787864929.527340:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787864929.527341:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787864929.527342:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787864929.527343:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787864929.527344:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787864929.527345:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787864929.527346:0:19400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787864929.527369:0:19400:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787864929.527387:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787864929.527459:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.527573:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.527714:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926208 00000100:00100000:1.0:1787864929.527722:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926208 00000100:00100000:1.0:1787864929.527803:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787864929.527812:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:19400:x1874711844926208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787864929.527849:0:17073:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787864929.527852:0:17073:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787864929.527856:0:17073:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787864929.528194:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+21:19400:x1874711844926208:12345-0@lo:253:mount.lustre.0 Request processed in 382us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.528211:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787864929.528305:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787864929.528314:0:19400:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787864929.528316:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787864929.528318:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787864929.528319:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787864929.528320:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787864929.528321:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787864929.528322:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787864929.528323:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787864929.528325:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787864929.528326:0:19400:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787864929.528342:0:19400:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92755fbeb800 from lustre-OST0001 10000000:01000000:3.0:1787864929.528371:0:19400:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787864929.528373:0:19400:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787864929.528381:0:19400:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92754aaf1a48 local copy 00010000:00010000:3.0:1787864929.528390:0:19400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864929.528478:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864929.528508:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.528870:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275458d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.532319:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926336 00000100:00100000:2.0:1787864929.532334:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926336 00000100:00100000:1.0:1787864929.532526:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787864929.532693:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:19400:x1874711844926336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787864929.532835:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:19400:x1874711844926336:12345-0@lo:501:mount.lustre.0 Request processed in 147us (4325us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787864929.532843:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787864929.533126:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787864929.533160:0:19400:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.136@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787864929.533184:0:19400:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.136@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787864929.533192:0:19400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.533203:0:19400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824f200/0x2fcb8c294dc443a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc443ad expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787864929.533301:0:19400:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92755fbeb800 10000000:01000000:3.0:1787864929.533307:0:19400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787864929.533313:0:19400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787864929.533315:0:19400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787864929.533320:0:19400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787864929.533322:0:19400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787864929.533350:0:19400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.533358:0:19400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.533367:0:19400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864929.533387:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787864929.533422:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.533457:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275458d3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.533514:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926464 00000100:00100000:1.0:1787864929.533519:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926464 00000100:00100000:1.0:1787864929.533707:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787864929.533716:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:19400:x1874711844926464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787864929.533726:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864929.533737:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757d948200/0x2fcb8c294dc4475e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44757 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.533757:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d948200/0x2fcb8c294dc4475e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44757 expref: 22 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.533767:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757d948200/0x2fcb8c294dc4475e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44757 expref: 22 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.533774:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757d948200, rc 0) 00000100:00100000:1.0:1787864929.533810:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926464:12345-0@lo:101:mount.lustre.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.533815:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787864929.533965:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864929.533978:0:19400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4475e expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.533995:0:19400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4475e expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787864929.535353:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787864929.536186:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787864929.539150:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787864929.539200:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787864929.539217:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787864929.539231:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787864929.539361:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787864929.539377:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787864929.539403:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787864929.539409:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787864929.539513:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864929.539705:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.539800:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff927448283f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.539851:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926592 00000100:00100000:2.0:1787864929.539858:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926592 00000100:00100000:3.0:1787864929.540167:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787864929.540178:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787864929.540343:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926592:12345-0@lo:501:mount.lustre.0 Request processed in 167us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.540352:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787864929.540428:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864929.540476:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864929.540517:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.540768:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.540844:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926720 00000100:00100000:1.0:1787864929.540850:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926720 00000100:00100000:1.0:1787864929.540878:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787864929.540926:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787864929.541855:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926720:12345-0@lo:503:mount.lustre.0 Request processed in 927us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.541864:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787864929.542009:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787864929.542432:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864929.542523:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864929.542585:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.542609:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.543175:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926848 00000100:00100000:1.0:1787864929.543180:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926848 00000100:00100000:1.0:1787864929.543212:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787864929.543220:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864929.543747:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926848:12345-0@lo:502:mount.lustre.0 Request processed in 526us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.543756:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787864929.543854:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787864929.544113:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787864929.544142:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787864929.544160:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787864929.544175:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787864929.544190:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787864929.544206:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787864929.544221:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787864929.544250:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787864929.544269:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787864929.544301:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864929.544346:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.544369:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.544653:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844926976 00000100:00100000:1.0:1787864929.544658:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844926976 00000100:00100000:1.0:1787864929.544687:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787864929.544695:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864929.544784:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844926976:12345-0@lo:502:mount.lustre.0 Request processed in 89us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.544791:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787864929.545333:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844926976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787864929.545387:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787864929.545396:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787864929.546165:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787864929.546172:0:19404:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787864929.546179:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787864929.546181:0:19404:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787864929.546186:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787864929.546200:0:19404:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92755ef83490) 00000020:00000080:1.0:1787864929.546221:0:19404:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787864929.546226:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787864929.546365:0:19404:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92755fbeb800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787864929.546374:0:19404:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787864929.546393:0:19404:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2fcb8c294dc4476c 00010000:00010000:1.0:1787864929.551354:0:19404:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787864929.552129:0:19404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1787864929.553758:0:19404:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787864929.556429:0:19404:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787864929.556442:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864929.556449:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864929.556451:0:19404:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787864929.556455:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864929.556459:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864929.556461:0:19404:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787864929.556471:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787864929.556473:0:19404:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787864929.556476:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864929.556478:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864929.556480:0:19404:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787864929.556482:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787864929.556485:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864929.556486:0:19404:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787864929.556489:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787864929.556512:0:19404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787864929.556515:0:19404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787864929.556517:0:19404:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787864929.556520:0:19404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787864929.556802:0:19400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787864929.556830:0:19400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787864929.556860:0:19400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4475e expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.556871:0:19400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92744824e600/0x2fcb8c294dc44757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4475e expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864929.556879:0:19400:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92755fbeb800 from 1 10000000:01000000:2.0:1787864929.556883:0:19400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864929.556957:0:19400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.556966:0:19400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.556976:0:19400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864929.556999:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844927104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787864929.557083:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.557119:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787864929.557268:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927104 00000100:00100000:0.0:1787864929.557276:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927104 00000100:00100000:0.0:1787864929.557326:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787864929.557336:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:19400:x1874711844927104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864929.557349:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864929.557362:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44773 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.557384:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.557394:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.557403:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb200, rc 0) 00000100:00100000:0.0:1787864929.557442:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844927104:12345-0@lo:101:mount.lustre.0 Request processed in 108us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864929.557449:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787864929.557982:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844927104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787864929.557998:0:19400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.558008:0:19400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787864929.559355:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787864929.559737:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787864929.559930:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787864929.560153:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787864929.560175:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787864929.560180:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787864929.560829:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844927232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864929.561010:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844927360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864929.561048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.561113:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927360 00000100:00100000:0.0:1787864929.561119:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927360 00000100:00100000:0.0:1787864929.561168:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787864929.561177:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844927360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864929.561204:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864929.561259:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844927360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864929.561274:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787864929.561294:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864929.561323:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844927360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787864929.562047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.562052:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787864929.562054:0:8:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787864929.562060:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1787864929.562063:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787864929.562080:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:0.0:1787864929.562100:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92757dc15a40 x1874711844927616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787864929.562133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.562137:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864929.562140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.562143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787864929.562175:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844927872:0@lo:400:kworker.0 00000100:00100000:0.0:1787864929.562217:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.562349:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844927488:0@lo:400:kworker.0 00000100:00100000:0.0:1787864929.562395:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864929.562402:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844928000:0@lo:400:kworker.0 00000100:00100000:1.0:1787864929.564052:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844927744:0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.564472:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.564519:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864929.564750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.564776:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844928128:0@lo:400:kworker.0 00000100:00100000:3.0:1787864929.564807:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.564846:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927872 00000100:00100000:3.0:1787864929.564852:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927872 00000100:00100000:3.0:1787864929.564907:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927488 00000100:00100000:3.0:1787864929.564911:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927488 00000100:00100000:3.0:1787864929.564928:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787864929.564950:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844927872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864929.565004:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844927872:12345-0@lo:400:kworker.0 Request processed in 55us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.565012:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787864929.565029:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787864929.565035:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844927488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864929.565078:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844927488:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.565098:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787864929.565140:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844927488:0@lo:400:kworker.0 00000100:00100000:3.0:1787864929.565166:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844927616:0@lo:8:kworker.0 00000100:00100000:3.0:1787864929.565208:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864929.565374:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927616 00000100:00100000:3.0:1787864929.565380:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927616 00000100:00100000:3.0:1787864929.565402:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787864929.565407:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1874711844927616:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787864929.565459:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1874711844927616:12345-0@lo:8:kworker.0 Request processed in 50us (251us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787864929.565466:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787864929.565489:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864929.565496:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787864929.565500:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787864929.565503:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc15a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844927616:0@lo:8:kworker.0 00000100:00100000:0.0:1787864929.565816:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.565914:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844927872:0@lo:400:kworker.0 00000100:00100000:0.0:1787864929.566223:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927232 00000100:00100000:0.0:1787864929.566228:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927232 00000100:00100000:0.0:1787864929.566350:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787864929.566357:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844927232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864929.566479:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844927232:12345-0@lo:501:mount.lustre.0 Request processed in 123us (2008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864929.566486:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787864929.566766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864929.569848:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844928256:0@lo:400:kworker.0 00000100:00100000:1.0:1787864929.569928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.570098:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928128 00000100:00100000:2.0:1787864929.570106:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928128 00000100:00100000:2.0:1787864929.570171:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928000 00000100:00100000:2.0:1787864929.570175:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928000 00000100:00100000:2.0:1787864929.570188:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844927744 00000100:00100000:2.0:1787864929.570191:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844927744 00000100:00100000:2.0:1787864929.570206:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864929.570214:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844928128:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787864929.570315:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864929.570397:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844928128:12345-0@lo:400:kworker.0 Request processed in 182us (5588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.570404:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864929.570421:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864929.570427:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844928000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.570462:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844928000:12345-0@lo:400:kworker.0 Request processed in 36us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.570468:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787864929.570480:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787864929.570485:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844927744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.570512:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844927744:12345-0@lo:400:kworker.0 Request processed in 27us (3747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.570518:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787864929.570578:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dc152c0 x1874711844928000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864929.570604:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844928000:0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.570643:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844927232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864929.570688:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864929.570733:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.570757:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928384 00000100:00100000:2.0:1787864929.570761:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928384 00000100:00100000:2.0:1787864929.570791:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787864929.570798:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928384:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864929.570914:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928384:12345-0@lo:503:mount.lustre.0 Request processed in 115us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.570921:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1787864929.571176:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dc17480 x1874711844928128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864929.571187:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844928128:0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.571270:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7240 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.571284:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928384:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787864929.571758:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787864929.571823:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864929.571867:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.572029:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787864929.572655:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928512 00000100:00100000:3.0:1787864929.572662:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928512 00000100:00100000:3.0:1787864929.572742:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787864929.572752:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864929.572868:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928512:12345-0@lo:502:mount.lustre.0 Request processed in 118us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.572880:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:1.0:1787864929.574402:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dc17840 x1874711844927744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864929.574418:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dc17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844927744:0@lo:400:kworker.0 00000100:00100000:1.0:1787864929.574455:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928256 00000100:00100000:1.0:1787864929.574461:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928256 00000100:00100000:1.0:1787864929.574510:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864929.574518:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9275589970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844928256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864929.574589:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9275589970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844928256:12345-0@lo:400:kworker.0 Request processed in 71us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.574595:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787864929.574615:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787864929.574633:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92757dbb9680 x1874711844928256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864929.574641:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844928256:0@lo:400:kworker.0 00000100:00100000:2.0:1787864929.575855:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787864929.576337:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787864929.576368:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787864929.576383:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787864929.576395:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787864929.576413:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787864929.576428:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787864929.576462:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787864929.576479:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1787864929.576491:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787864929.576503:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1787864929.576517:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1787864929.576745:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864929.576808:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.576852:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92755fbb7900 going to sleep for 11 seconds 00000100:00100000:0.0:1787864929.577130:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928640 00000100:00100000:0.0:1787864929.577137:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928640 00000100:00100000:0.0:1787864929.577508:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787864929.577519:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864929.577785:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928640:12345-0@lo:502:mount.lustre.0 Request processed in 267us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864929.577793:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787864929.577876:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a96580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787864929.578005:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1787864929.578016:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787864929.579231:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864929.579254:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579256:0:19408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787864929.579264:0:19408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92755fbeb800 00000020:00000080:2.0:1787864929.579267:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864929.579274:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864929.579277:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579278:0:19408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787864929.579280:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864929.579282:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579283:0:19408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787864929.579286:0:19408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92755fbeb800 00000020:00000080:2.0:1787864929.579288:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864929.579341:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864929.579345:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579346:0:19408:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787864929.579349:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864929.579352:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579353:0:19408:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787864929.579357:0:19408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92755fbeb800 00000020:00000080:2.0:1787864929.579359:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864929.579378:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864929.579381:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579383:0:19408:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787864929.579385:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787864929.579395:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579396:0:19408:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787864929.579400:0:19408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92755fbeb800 00000020:00000080:2.0:1787864929.579402:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787864929.579427:0:19408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787864929.579430:0:19408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787864929.579431:0:19408:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787864929.579434:0:19408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1787864929.579744:0:19400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787864929.579770:0:19400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864929.579793:0:19400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.579803:0:19400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864929.579864:0:19400:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787864929.579867:0:19400:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92755fbeb800 10000000:01000000:0.0:1787864929.579870:0:19400:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92755fbeb800 10000000:01000000:0.0:1787864929.579873:0:19400:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787864929.579878:0:19400:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92755fbeb800 from 1 10000000:01000000:0.0:1787864929.579881:0:19400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787864929.579947:0:19400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.579966:0:19400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.579976:0:19400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864929.579998:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787864929.580057:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.580104:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864929.581686:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928768 00000100:00100000:3.0:1787864929.581696:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928768 00000100:00100000:3.0:1787864929.581752:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787864929.581761:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:19400:x1874711844928768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787864929.581776:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864929.581792:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824f400/0x2fcb8c294dc44788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44781 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.581819:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824f400/0x2fcb8c294dc44788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44781 expref: 24 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.581832:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824f400/0x2fcb8c294dc44788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44781 expref: 24 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864929.581841:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824f400, rc 0) 00000100:00100000:3.0:1787864929.581950:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844928768:12345-0@lo:101:mount.lustre.0 Request processed in 189us (1892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.581956:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787864929.582045:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787864929.582063:0:19400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44788 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.582083:0:19400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44788 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864929.583518:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1787864929.583930:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864929.586111:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787864929.586155:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787864929.586173:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787864929.586187:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787864929.586202:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787864929.586215:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787864929.586227:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787864929.587083:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787864929.587106:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787864929.587121:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787864929.587149:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787864929.587162:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787864929.587174:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787864929.587188:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787864929.587201:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787864929.587213:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787864929.587227:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787864929.587254:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787864929.587269:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787864929.587283:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787864929.587298:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787864929.587313:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787864929.587327:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787864929.587342:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787864929.587359:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1787864929.587375:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1787864929.587392:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1787864929.587407:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1787864929.587422:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1787864929.587436:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1787864929.587447:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1787864929.587459:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1787864929.587471:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1787864929.587483:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1787864929.587496:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1787864929.587509:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1787864929.587523:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1787864929.589057:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1787864929.589109:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1787864929.589126:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1787864929.589141:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1787864929.589156:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1787864929.589171:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1787864929.589198:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1787864929.589214:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1787864929.589229:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1787864929.589688:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1787864929.589695:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1787864929.589807:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864929.589876:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.590661:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844928896 00000100:00100000:2.0:1787864929.590669:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844928896 00000100:00100000:2.0:1787864929.590716:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787864929.590725:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844928896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787864929.590858:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844928896:12345-0@lo:501:mount.lustre.0 Request processed in 134us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.590866:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787864929.591680:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864929.591707:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844928896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787864929.591754:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787864929.591805:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.591834:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd20f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.592052:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929024 00000100:00100000:2.0:1787864929.592058:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929024 00000100:00100000:2.0:1787864929.592102:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787864929.592110:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787864929.592202:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929024:12345-0@lo:503:mount.lustre.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.592209:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787864929.593192:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787864929.595916:0:19400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787864929.596024:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864929.596116:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.596158:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864929.598713:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929152 00000100:00100000:3.0:1787864929.598728:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929152 00000100:00100000:3.0:1787864929.598792:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787864929.598802:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787864929.599367:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929152:12345-0@lo:502:mount.lustre.0 Request processed in 564us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864929.599383:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787864929.599785:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864929.600055:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787864929.600102:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787864929.600119:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787864929.600133:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787864929.600151:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787864929.600166:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787864929.600181:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787864929.600195:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787864929.600209:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787864929.600249:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787864929.600267:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787864929.600283:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787864929.600298:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787864929.600313:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787864929.600326:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787864929.600339:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787864929.600351:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787864929.600363:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787864929.600375:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787864929.600387:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787864929.600398:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787864929.600408:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787864929.600419:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787864929.600432:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787864929.600460:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1787864929.600477:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1787864929.600490:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1787864929.600502:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1787864929.600514:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1787864929.600527:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1787864929.600847:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1787864929.600866:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1787864929.600881:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1787864929.600937:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1787864929.600953:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1787864929.600966:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1787864929.600980:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1787864929.600994:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1787864929.601008:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1787864929.601021:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1787864929.601051:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1787864929.601082:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1787864929.601109:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1787864929.601125:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1787864929.601140:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1787864929.601156:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1787864929.601170:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1787864929.601183:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1787864929.601442:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864929.601516:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.601680:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.602355:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929280 00000100:00100000:1.0:1787864929.602362:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929280 00000100:00100000:1.0:1787864929.602414:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787864929.602423:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929280:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787864929.602581:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929280:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864929.602589:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787864929.602786:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864929.603145:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787864929.603171:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787864929.603994:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929408:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787864929.604061:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.604147:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.609296:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929408 00000100:00100000:2.0:1787864929.609309:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929408 00000100:00100000:2.0:1787864929.609375:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787864929.609384:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787864929.615038:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929408:12345-0@lo:502:mount.lustre.0 Request processed in 5645us (10967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.615062:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787864929.615358:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787864929.615449:0:19400:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787864929.615462:0:19400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787864929.620125:0:19413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787864929.620144:0:19413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92757bdf0000) 00000020:00000080:2.0:1787864929.620168:0:19413:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1787864929.620276:0:19413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92755fbeb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787864929.620280:0:19413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92755fbeb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787864929.620283:0:19413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92755fbeb800 3 00010000:00080000:2.0:1787864929.620315:0:19413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92757de49000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.136@tcp at head 00010000:00010000:2.0:1787864929.621961:0:19413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787864929.628494:0:19413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787864929.629336:0:19413:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787864929.629351:0:19413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2fcb8c294dc44796 00000100:00080000:3.0:1787864929.629364:0:19413:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787864929.629369:0:19413:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92757de49000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864929.629403:0:19413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9274481870c0 x1874711844929536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864929.629444:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844929536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787864929.629511:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864929.629684:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929536 00000100:00100000:0.0:1787864929.629690:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929536 00000100:00100000:0.0:1787864929.629721:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787864929.629728:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3636:x1874711844929536:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787864929.629749:0:17082:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1787864929.629791:0:17082:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2fcb8c294dc4479d 00000004:00100000:0.0:1787864929.629804:0:17082:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787864929.629836:0:17082:0:(import.c:65:import_set_state_nolock()) ffff92757c3e9000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787864929.629929:0:19413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1787864929.634976:0:19413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787864929.635005:0:19413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff927446e60000) 00000020:00000080:2.0:1787864929.635031:0:19413:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787864929.635123:0:19413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92755fbeb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787864929.635127:0:19413:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92755fbeb800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787864929.635130:0:19413:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92755fbeb800 3 00010000:00080000:2.0:1787864929.635161:0:19413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff927548606000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.136@tcp at head 00000100:00080000:0.0:1787864929.639088:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.639101:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864929.639104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.639107:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787864929.639186:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874711844929536:12345-0@lo:38:llog_process_th.0 Request processed in 9453us (9671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864929.639199:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787864929.640373:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9274481870c0 x1874711844929536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864929.640386:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787864929.640396:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787864929.640404:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787864929.640409:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787864929.640412:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92757de49000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787864929.640419:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3636:1874711844929536:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1787864929.641415:0:19413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787864929.642401:0:19413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787864929.642446:0:19413:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787864929.642467:0:19413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2fcb8c294dc447ab 00000100:00080000:2.0:1787864929.642477:0:19413:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787864929.642482:0:19413:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff927548606000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:2.0:1787864929.642513:0:19413:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448a94b40 x1874711844929664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787864929.642747:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844929664:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787864929.642990:0:19413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787864929.643365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.643371:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787864929.643373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787864929.643376:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787864929.643708:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.643873:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929664 00000100:00100000:2.0:1787864929.643885:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929664 00000100:00100000:2.0:1787864929.644390:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864929.644396:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3636:x1874711844929664:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787864929.644426:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1787864929.644468:0:17083:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2fcb8c294dc447b2 00000004:00100000:2.0:1787864929.644483:0:17083:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787864929.644516:0:17083:0:(import.c:65:import_set_state_nolock()) ffff927441e2e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864929.646161:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874711844929664:12345-0@lo:38:llog_process_th.0 Request processed in 1757us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.646174:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787864929.646609:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff927448a94b40 x1874711844929664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787864939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864929.646623:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787864929.646632:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787864929.646641:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787864929.646646:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787864929.646649:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927548606000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787864929.646657:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3636:1874711844929664:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787864929.647806:0:19413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1787864929.648348:0:19400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787864929.648379:0:19400:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787864929.648399:0:19400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44788 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864929.648409:0:19400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5bb600/0x2fcb8c294dc44781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44788 expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787864929.648457:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787864929.648459:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787864929.648460:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864929.648462:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864929.648463:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864929.648465:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864929.648466:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864929.648468:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864929.648470:0:19400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864929.648473:0:19400:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787864929.648476:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787864929.648477:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787864929.648478:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787864929.648479:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787864929.648480:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787864929.648482:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787864929.648483:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787864929.648484:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787864929.648485:0:19400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787864929.648507:0:19400:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787864929.648524:0:19400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929792:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787864929.649184:0:19400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864929.649261:0:19400:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864929.655350:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929792 00000100:00100000:2.0:1787864929.655364:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929792 00000100:00100000:2.0:1787864929.655426:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787864929.655436:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787864929.655468:0:17073:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787864929.655483:0:17073:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787864929.659253:0:17073:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787864929.659271:0:17073:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787864929.659820:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:19400:x1874711844929792:12345-0@lo:253:mount.lustre.0 Request processed in 4381us (10633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.659831:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 20000000:01000000:1.0:1787864929.659919:0:17097:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787864929.659924:0:17097:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787864929.659944:0:17097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.659960:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.659967:0:17097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 23 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.659974:0:17097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.660011:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 23 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.660023:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 23 pid: 17076 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864929.660036:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844929920:0@lo:104: 00000100:00100000:1.0:1787864929.660082:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787864929.660124:0:17097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864929.660140:0:17097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 23 pid: 17075 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864929.660149:0:17097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844930048:0@lo:104: 00000100:00100000:1.0:1787864929.660175:0:17097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864929.660189:0:17097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274481f3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787864929.660222:0:19400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:af099440-ba6e-4600-a03b-1ca45ea8912e:19400:1874711844929792:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787864929.660244:0:19400:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787864929.660247:0:19400:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787864929.660249:0:19400:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787864929.660251:0:19400:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787864929.660252:0:19400:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787864929.660253:0:19400:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787864929.660254:0:19400:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787864929.660256:0:19400:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787864929.660258:0:19400:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787864929.660259:0:19400:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787864929.660271:0:19400:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787864929.660711:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844929920 00000100:00100000:2.0:1787864929.660719:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844929920 00000100:00100000:2.0:1787864929.660748:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930048 00000100:00100000:2.0:1787864929.660751:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930048 00000100:00100000:2.0:1787864929.660766:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864929.660774:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844929920:12345-0@lo:104: 00010000:00010000:2.0:1787864929.660787:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.660840:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787864929.660847:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+4:17097:x1874711844929920:12345-0@lo:104: Request processed in 74us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.660853:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864929.660867:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864929.660874:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844930048:12345-0@lo:104: 00010000:00010000:2.0:1787864929.660881:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.660935:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787864929.660940:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:17097:x1874711844930048:12345-0@lo:104: Request processed in 67us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.660947:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787864929.660966:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864929.660972:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.660992:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864929.660995:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661004:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864929.661011:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864929.661016:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864929.661046:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661052:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864929.661085:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661093:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030000/0x2fcb8c294dc44670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44677 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661106:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864929.661109:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661115:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:2.0:1787864929.661118:0:17070:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661136:0:17070:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787864929.661142:0:17070:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787864929.661147:0:17070:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787864929.661161:0:17070:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661168:0:17070:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787864929.661174:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661181:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031200/0x2fcb8c294dc44662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc44669 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661193:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864929.661195:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864929.661197:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864929.661203:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864929.661216:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844930176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864929.661248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.661273:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864929.661280:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844930304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864929.661300:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864929.661330:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930176 00000100:00100000:2.0:1787864929.661334:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930176 00010000:00010000:2.0:1787864929.661357:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 24 pid: 17076 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864929.661378:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930304 00000100:00100000:2.0:1787864929.661380:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930304 00010000:00010000:2.0:1787864929.661390:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 25 pid: 17075 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864929.661402:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864929.661408:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+25:3639:x1874711844930176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864929.661418:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864929.661423:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 25 pid: 17076 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661433:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 25 pid: 17076 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661448:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864929.661476:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+25:3639:x1874711844930176:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.661482:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787864929.661494:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864929.661500:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3639:x1874711844930304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864929.661506:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864929.661510:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 24 pid: 17075 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.661518:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 24 pid: 17075 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662425:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662437:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787864929.662452:0:17066:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011569745s 00010000:00010000:2.0:1787864929.662456:0:17066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662463:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662469:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662475:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662481:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864929.662486:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662493:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662501:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.662510:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864929.662758:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3639:x1874711844930304:12345-0@lo:103:ldlm_bl.0 Request processed in 1255us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864929.664477:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787864929.664571:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844930304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787864929.664583:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844930176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787864929.664619:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d948600/0x2fcb8c294dc44677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44670 expref: 23 pid: 17076 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864929.664631:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844929920:0@lo:104: 00010000:00010000:2.0:1787864929.664642:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949200/0x2fcb8c294dc44669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44662 expref: 22 pid: 17075 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864929.664650:0:17097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17097:1874711844930048:0@lo:104: 00010000:00010000:2.0:1787864929.664666:0:17097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.664675:0:17097:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.664680:0:17097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864929.664685:0:17097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92757d949a00/0x2fcb8c294dc447b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787864929.673836:0:19400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787864929.677115:0:19400:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787864929.677124:0:19400:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787864929.677157:0:19400:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787864929.677195:0:19400:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.136@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787864929.677214:0:19400:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1787864929.677231:0:19400:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1787864929.678124:0:19400:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787864929.678382:0:19400:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864930.202973:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787864930.462311:0:19467:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864930.463497:0:19467:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787864930.649407:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864915/real 1787864915] req@ffff927558996940 x1874711844918144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864930 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864930.649436:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff927558996940 x1874711844918144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864930 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864930.649447:0:3636:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787864915/real 1787864915] req@ffff927558994780 x1874711844918272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864930 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864930.649458:0:3636:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff927558994780 x1874711844918272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787864930 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787864930.649478:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927568d11000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864930.649495:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787864930.649499:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844918144:0@lo:8:kworker.0 00000100:00080000:0.0:1787864930.649505:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92744822e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787864930.649510:0:3636:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787864930.649513:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844918272:0@lo:8:kworker.0 00000100:00100000:3.0:1787864930.649930:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844930432:0@lo:400:kworker.0 00000100:00080000:1.0:1787864930.649930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864930.649952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787864930.649955:0:8:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864930.649965:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff927446e01800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864930.649996:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927448bffc00 x1874711844930816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864930.649998:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864930.650032:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787864930.650036:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787864930.650038:0:8:0:(import.c:65:import_set_state_nolock()) ffff927568d11000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864930.650042:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 440 00000100:00100000:3.0:1787864930.650046:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844931072:0@lo:400:kworker.0 00000100:00080000:1.0:1787864930.650048:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787864930.650056:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff927568d11000 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:1.0:1787864930.650080:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927447c90b40 x1874711844931200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787864930.650091:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1787864930.650092:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787864930.650097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787864930.650100:0:8:0:(import.c:65:import_set_state_nolock()) ffff92744822e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787864930.650105:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1787864930.650108:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787864930.650112:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff92744822e800 using connection 192.168.206.136@tcp/0@lo 00000100:00100000:3.0:1787864930.650117:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864930.650125:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff927447c921c0 x1874711844931328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787864930.650126:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844930560:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650160:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650186:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844931840:0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650197:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844930688:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650217:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650241:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787864930.650245:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650251:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844931456:0@lo:400:kworker.0 00000100:00100000:0.0:1787864930.650266:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844930816:0@lo:8:kworker.0 00000100:00100000:1.0:1787864930.650275:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844931584:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650282:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650306:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844931968:0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650312:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.650330:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864930.650341:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787864930.650350:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844930944:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650356:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.650372:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844931200:0@lo:8:kworker.0 00000100:00100000:3.0:1787864930.650395:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930432 00000100:00100000:1.0:1787864930.650399:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650403:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930432 00000100:00100000:1.0:1787864930.650416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844931712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650449:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787864930.650459:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:3637:x1874711844930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650469:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931840 00000100:00100000:1.0:1787864930.650474:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931840 00000100:00100000:3.0:1787864930.650509:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:3637:x1874711844930432:12345-0@lo:400:kworker.0 Request processed in 52us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.650510:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931456 00000100:00100000:1.0:1787864930.650514:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931456 00000100:00100000:3.0:1787864930.650521:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787864930.650529:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931584 00000100:00100000:1.0:1787864930.650533:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931584 00000100:00100000:1.0:1787864930.650550:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931968 00000100:00100000:1.0:1787864930.650552:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931968 00000100:00100000:3.0:1787864930.650557:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931072 00000100:00100000:3.0:1787864930.650562:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931072 00000100:00100000:1.0:1787864930.650569:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930944 00000100:00100000:1.0:1787864930.650574:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930944 00000100:00100000:3.0:1787864930.650590:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930560 00000100:00100000:1.0:1787864930.650594:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931712 00000100:00100000:3.0:1787864930.650595:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930560 00000100:00100000:1.0:1787864930.650599:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931712 00000100:00100000:3.0:1787864930.650620:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864930.650625:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864930.650630:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844931072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650637:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844931840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650672:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844931072:12345-0@lo:400:kworker.0 Request processed in 44us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.650683:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864930.650684:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448187c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844931840:12345-0@lo:400:kworker.0 Request processed in 47us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.650692:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787864930.650700:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787864930.650709:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650711:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864930.650723:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650748:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448185e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844930560:12345-0@lo:400:kworker.0 Request processed in 41us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.650755:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787864930.650762:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844931456:12345-0@lo:400:kworker.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.650769:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787864930.650781:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787864930.650788:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787864930.650793:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844931584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.650801:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.650837:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844931584:12345-0@lo:400:kworker.0 Request processed in 48us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.650844:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844931968:12345-0@lo:400:kworker.0 Request processed in 46us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864930.650846:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.650858:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864930.650906:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844931328:0@lo:8:kworker.0 00000100:00100000:2.0:1787864930.650938:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930688 00000100:00100000:2.0:1787864930.650943:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930688 00000100:00100000:0.0:1787864930.650948:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.650989:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844930816 00000100:00100000:2.0:1787864930.650993:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844930816 00000100:00100000:0.0:1787864930.650996:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931200 00000100:00100000:0.0:1787864930.651001:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931200 00000100:00100000:2.0:1787864930.651009:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844931328 00000100:00100000:2.0:1787864930.651013:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844931328 00000100:00100000:0.0:1787864930.651021:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787864930.651030:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.651142:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787864930.651154:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864930.651161:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787864930.651165:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844930944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.651173:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844931712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.651207:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844930944:12345-0@lo:400:kworker.0 Request processed in 46us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.651215:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787864930.651220:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874711844931712:12345-0@lo:400:kworker.0 Request processed in 49us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.651228:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787864930.652001:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844930688:12345-0@lo:400:kworker.0 Request processed in 971us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864930.652525:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787864930.652531:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3636:x1874711844930816:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787864930.652560:0:18591:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1787864930.652586:0:18591:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2fcb8c294dc447c0 00000100:00100000:3.0:1787864930.652994:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864930.653002:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3636:x1874711844931200:12345-0@lo:8:kworker.0 00002000:00100000:2.0:1787864930.653012:0:18591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff927441e2a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787864930.653018:0:18591:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787864930.653021:0:18591:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1787864930.653024:0:18590:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1787864930.653046:0:18590:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc447c7 00002000:00100000:3.0:1787864930.653055:0:18590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9274483d0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1787864930.653059:0:18590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1787864930.653075:0:18590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787864930.653129:0:18590:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1787864930.653152:0:18590:0:(import.c:65:import_set_state_nolock()) ffff9274483d6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864930.653215:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844931200:12345-0@lo:8:kworker.0 Request processed in 212us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.653223:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787864930.653242:0:18590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787864930.653250:0:18590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787864930.653301:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864930.653309:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787864930.653315:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787864930.653319:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787864930.653322:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927568d11000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787864930.653335:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787864930.653351:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844931200:0@lo:8:kworker.0 00000004:00080000:3.0:1787864930.653405:0:17824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787864930.653425:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932224:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787864930.653458:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.653470:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275458d3480 going to sleep for 11 seconds 00000004:00080000:3.0:1787864930.653485:0:17823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787864930.653541:0:17823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 455715651468ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787864930.653549:0:17823:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1787864930.653588:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787864930.653598:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3636:x1874711844931328:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787864930.653599:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787864930.653632:0:18740:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:1.0:1787864930.653658:0:18740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2fcb8c294dc447ce 00002000:00100000:1.0:1787864930.653664:0:18740:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9274470cf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787864930.653668:0:18740:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787864930.653670:0:18740:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787864930.653697:0:18740:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787864930.653710:0:18740:0:(import.c:65:import_set_state_nolock()) ffff9274470cd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864930.653744:0:18589:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1787864930.653746:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3636:x1874711844931328:12345-0@lo:8:kworker.0 Request processed in 150us (2797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.653756:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864930.653756:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932224 00000100:00100000:0.0:1787864930.653763:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932224 00000100:00080000:1.0:1787864930.653784:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864930.653789:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864930.653868:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864930.653877:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17824:x1874711844932224:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1787864930.653906:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787864930.653947:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844932096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864930.653985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787864930.654018:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448bfde00 x1874711844930944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864930.654042:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844930944:0@lo:400:kworker.0 00010000:00080000:1.0:1787864930.654056:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c92940 x1874711844931712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864930.654078:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3639:1874711844931712:0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.654091:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844930688:0@lo:400:kworker.0 00010000:00080000:1.0:1787864930.654101:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c930c0 x1874711844931584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864930.654110:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844931584:0@lo:400:kworker.0 00000100:00100000:1.0:1787864930.654145:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932096 00000100:00100000:1.0:1787864930.654149:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932096 00000100:00100000:1.0:1787864930.654172:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864930.654178:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1874711844932096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787864930.654191:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1787864930.654225:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3639:x1874711844932096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.654231:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864930.654263:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274481852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844932096:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787864930.654291:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c92580 x1874711844931456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864930.654303:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844931456:0@lo:400:kworker.0 00010000:00080000:3.0:1787864930.654316:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c91a40 x1874711844931968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864930.654325:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844931968:0@lo:400:kworker.0 00010000:00080000:3.0:1787864930.654336:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c93840 x1874711844931840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864930.654344:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844931840:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.654355:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844930560:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.654366:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844931072:0@lo:400:kworker.0 00000100:00100000:3.0:1787864930.654375:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844930432:0@lo:400:kworker.0 00010000:00080000:3.0:1787864930.654466:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c921c0 x1874711844931328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864930.654474:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787864930.654486:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787864930.654492:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787864930.654496:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787864930.654498:0:3636:0:(import.c:65:import_set_state_nolock()) ffff92744822e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787864930.654510:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787864930.654514:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3636:1874711844931328:0@lo:8:kworker.0 00002000:00080000:2.0:1787864930.655211:0:18591:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787864930.655241:0:18591:0:(import.c:65:import_set_state_nolock()) ffff927441e2c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864930.655296:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1874711844930816:12345-0@lo:8:kworker.0 Request processed in 2762us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864930.655303:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787864930.655338:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448bffc00 x1874711844930816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787864955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787864930.655356:0:3636:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787864930.655364:0:3636:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787864930.655368:0:3636:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787864930.655370:0:3636:0:(import.c:65:import_set_state_nolock()) ffff927446e01800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787864930.655382:0:3636:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787864930.655385:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3636:1874711844930816:0@lo:8:kworker.0 00000004:00080000:2.0:1787864930.655431:0:17108:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1787864930.655448:0:17108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17108:1874711844932480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787864930.655487:0:17108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.655504:0:17108:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd9f00 going to sleep for 11 seconds 00000004:00080000:2.0:1787864930.655517:0:17107:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787864930.655587:0:17107:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 455717697616ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787864930.655593:0:17107:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787864930.655616:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844932352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864930.655732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.655875:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932352 00000100:00100000:2.0:1787864930.655880:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932352 00000004:00080000:0.0:1787864930.656590:0:17826:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787864930.656609:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844932736:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787864930.656877:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.656929:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000004:00080000:0.0:1787864930.656945:0:17825:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787864930.657006:0:17825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 455719116269ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787864930.657012:0:17825:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787864930.657031:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844932608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864930.657149:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864930.657169:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932608 00000100:00100000:1.0:1787864930.657177:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932608 00000100:00100000:0.0:1787864930.657187:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932480 00000100:00100000:0.0:1787864930.657193:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932480 00000100:00100000:1.0:1787864930.657214:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864930.657224:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874711844932608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864930.657243:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787864930.657288:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1874711844932608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.657300:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787864930.657338:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbba940 x1874711844932608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864930.657355:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844932608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864930.657460:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787864930.657467:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874711844932352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864930.657478:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932736 00000100:00100000:0.0:1787864930.657484:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932736 00002000:00000024:2.0:1787864930.657493:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787864930.657512:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864930.657522:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17108:x1874711844932480:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787864930.657536:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874711844932352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1892us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864930.657544:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787864930.657564:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787864930.657587:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448a94b40 x1874711844932352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787864946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864930.657603:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844932352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864930.657628:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787864930.657635:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17826:x1874711844932736:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1787864930.660359:0:17814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787864930.660397:0:18589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787864930.660404:0:18589:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787864930.661530:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17824:x1874711844932224:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7649us (8065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.661542:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787864930.661678:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932224:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1787864930.661691:0:17824:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000004:00080000:0.0:1787864930.661740:0:17061:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1787864930.663204:0:18590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787864930.663214:0:18590:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787864930.663219:0:18590:0:(ofd_dev.c:1495:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:1.0:1787864930.663268:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932864:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787864930.663327:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864930.663650:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d0c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787864930.666408:0:17814:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787864930.666436:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932864 00000100:00100000:3.0:1787864930.666446:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932864 00000100:00100000:3.0:1787864930.666501:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864930.666512:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17824:x1874711844932864:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787864930.666540:0:18740:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787864930.666953:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17824:x1874711844932864:12345-0@lo:5:osp-pre-0-1.0 Request processed in 443us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.666961:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864930.671096:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932864:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787864930.671116:0:17824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1787864930.671161:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932992:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1787864930.671217:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.671319:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844932992 00000100:00100000:3.0:1787864930.671326:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844932992 00000100:00100000:1.0:1787864930.671352:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92754576d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864930.671377:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787864930.671387:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17824:x1874711844932992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787864930.671426:0:18589:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00002000:00080000:2.0:1787864930.671779:0:18591:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787864930.671786:0:18591:0:(ofd_dev.c:1212:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787864930.671840:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17826:x1874711844932736:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14203us (14961us total) trans 0 rc 0/0 00002000:00010000:1.0:1787864930.672445:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.672453:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.672469:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.672473:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.672480:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.672508:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.672519:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.672528:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.672679:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864930.673006:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787864930.673074:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787864930.673090:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.673113:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864930.673118:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.673129:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1787864930.673145:0:17826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbb8b40 x1874711844932736/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787864946 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864930.673158:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb8b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844932736:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787864930.673169:0:17826:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00010000:00010000:3.0:1787864930.673195:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.673203:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000678d06a3/0x2fcb8c294dc447d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864930.673210:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844933120:0@lo:5:osp-pre-1-1.0 00010000:00010000:3.0:1787864930.673226:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.673229:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.673230:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864930.673269:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.673292:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864930.673311:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933120 00000100:00100000:2.0:1787864930.673315:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933120 00000100:00100000:2.0:1787864930.673352:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787864930.673359:0:19485:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:2.0:1787864930.673361:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17826:x1874711844933120:12345-0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787864930.673371:0:19485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00002000:00080000:2.0:1787864930.673386:0:18740:0:(ofd_dev.c:1644:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1787864930.673425:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17826:x1874711844933120:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864930.673432:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864930.673465:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844933120:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787864930.673473:0:17826:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787864930.673493:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844933248:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787864930.673513:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.673529:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff92756dfd90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787864930.673534:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933248 00000100:00100000:3.0:1787864930.673540:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933248 00000100:00100000:3.0:1787864930.673571:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864930.673578:0:18740:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1787864930.673579:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17826:x1874711844933248:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787864930.673604:0:18591:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1787864930.673681:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.673688:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.673698:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.673701:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.673705:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.673715:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.673723:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.673741:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.673760:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864930.674259:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.674266:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674274:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.674278:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.674282:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674291:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674299:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674306:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674323:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787864930.674332:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787864930.674337:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674350:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864930.674354:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674362:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674373:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674379:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037adf16f/0x2fcb8c294dc447dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674393:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864930.674396:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674403:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864930.674406:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674413:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674420:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674432:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040a3ac56/0x2fcb8c294dc447e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.674443:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864930.674444:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864930.674446:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.674739:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.675167:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.675174:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.675183:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.675186:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.675190:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.675199:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.675208:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.675216:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.675242:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864930.675296:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864930.675303:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.675322:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864930.675326:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.675334:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.675346:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.675353:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235f01e6/0x2fcb8c294dc447ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.675368:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.675370:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.675371:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.676128:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.676141:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.676150:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.676154:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.676159:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.676169:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.676177:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.676185:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.676201:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.676398:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.676404:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.676422:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.676425:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.676434:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.676447:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.676454:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007747ee5a/0x2fcb8c294dc447f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.676470:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.676471:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.676473:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787864930.677705:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787864930.677713:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677725:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1787864930.677729:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864930.677733:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677744:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677758:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677765:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677778:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.677787:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.677791:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677797:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.677801:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677808:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677819:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677826:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036899e27/0x2fcb8c294dc447f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.677839:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.677845:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.677847:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787864930.679670:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787864930.679680:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.679694:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1787864930.679698:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864930.679703:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.679714:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.679722:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.679729:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.679746:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864930.680045:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864930.680051:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.680059:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864930.680073:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.680082:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.680104:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.680111:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000447ad984/0x2fcb8c294dc447ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.680130:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.680131:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.680133:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787864930.681166:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787864930.681174:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.681186:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1787864930.681190:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864930.681195:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.681213:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.681222:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.681235:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.681252:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787864930.681531:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787864930.681537:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.681545:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:1.0:1787864930.681549:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.681558:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.681579:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.681587:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5d56967/0x2fcb8c294dc44806 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.681602:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864930.681604:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864930.681606:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.686627:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.686640:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.686656:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.686661:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.686668:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.686682:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.686693:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.686701:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.686741:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864930.686797:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864930.686806:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.686816:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864930.686821:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.686831:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.686850:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.686857:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e365c0fe/0x2fcb8c294dc4480d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.686916:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.686919:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.686921:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.687258:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.687264:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.687274:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.687277:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.687282:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.687291:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.687301:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.687308:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.687322:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787864930.687458:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787864930.687463:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.687470:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864930.687474:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.687481:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.687492:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.687499:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b910e31/0x2fcb8c294dc44814 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.687515:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.687517:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864930.687519:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.693124:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.693137:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693154:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.693164:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.693172:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693186:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693196:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693203:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693240:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.693519:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.693526:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.693535:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.693539:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.693549:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.693566:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.693574:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bb82e16/0x2fcb8c294dc4481b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.693599:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.693600:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.693602:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.693673:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.693679:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693688:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.693691:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.693696:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693705:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693713:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693726:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.693746:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.694027:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.694033:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694042:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.694046:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694055:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694077:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694084:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffd8b005/0x2fcb8c294dc44822 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694096:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.694098:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.694099:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.694174:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.694179:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694187:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.694190:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.694194:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694203:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694210:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694217:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694288:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864930.694664:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.694670:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694682:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.694685:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.694690:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694699:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694707:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694715:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.694725:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787864930.694922:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864930.694927:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694945:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949a00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.694949:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694957:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694968:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694976:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000159f6c5a/0x2fcb8c294dc44829 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.694990:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.694994:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.695001:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.695004:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.695011:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.695020:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.695033:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000690c3fd8/0x2fcb8c294dc44830 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.695045:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.695047:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.695048:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.695053:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.695142:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.695148:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695155:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.695159:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.695163:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695172:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695196:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695202:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695254:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864930.695874:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.695881:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695912:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.695915:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.695920:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695930:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695939:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.695947:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787864930.698862:0:18585:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1787864930.698876:0:18585:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1787864930.698925:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787864930.699096:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864930.699105:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699118:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92755387a400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.699123:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864930.699133:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17824:x1874711844932992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27741us (27910us total) trans 8589934594 rc 0/0 00010000:00010000:2.0:1787864930.699138:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864930.699148:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787864930.699160:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699168:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27333e0/0x2fcb8c294dc44837 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699192:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.699196:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864930.699205:0:17824:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787864930.699216:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17824:1874711844932992:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787864930.699235:0:17824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1787864930.699284:0:17824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17824:1874711844933376:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787864930.699318:0:17824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864930.699342:0:17824:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757d864cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864930.699367:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933376 00000100:00100000:1.0:1787864930.699372:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933376 00000100:00100000:1.0:1787864930.699473:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787864930.699484:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1874711844933376:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787864930.699531:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17824:x1874711844933376:12345-0@lo:900:osp-pre-0-1.0 Request processed in 50us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.699538:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787864930.699540:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796600 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.699546:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699556:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1787864930.699568:0:17824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c930c0 x1874711844933376/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864930.699579:0:17824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17824:1874711844933376:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787864930.699782:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699791:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b5f80e9/0x2fcb8c294dc4483e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.699808:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.699810:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.699812:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.699820:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.700152:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.700160:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700185:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.700190:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.700197:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700210:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700220:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700228:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700289:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.700407:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.700412:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700420:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.700424:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700443:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700455:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700463:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d942a0/0x2fcb8c294dc44845 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700479:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.700481:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.700482:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.700652:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.700658:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700667:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.700671:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.700676:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700686:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700706:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700714:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.700734:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.700920:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.700926:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.700935:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796400 already unused, calling callback (ffffffffc0dd8530) 00002000:00010000:1.0:1787864930.701060:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.701078:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701086:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.701089:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.701094:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701103:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701112:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701120:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701145:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.701253:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701265:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701278:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701297:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0778eea/0x2fcb8c294dc4484c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701312:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.701316:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701323:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.701327:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701335:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701346:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701354:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ad7389f/0x2fcb8c294dc44853 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701364:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.701366:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.701368:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.701374:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.701595:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.701601:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701610:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.701613:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.701618:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701639:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701648:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701657:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.701675:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.701842:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.701848:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701861:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.701864:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701873:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701917:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701927:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf38d4eb/0x2fcb8c294dc4485a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.701952:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.701954:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.701956:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.702532:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.702540:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.702550:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.702559:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.702565:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.702576:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.702585:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.702593:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.702607:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787864930.702995:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.703002:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703011:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.703014:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.703018:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703027:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703034:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703047:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703059:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787864930.703398:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.703404:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703414:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.703417:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.703421:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703429:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703437:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703444:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703458:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787864930.703484:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787864930.703492:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703503:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.703507:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703517:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703541:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703549:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2527d93/0x2fcb8c294dc44861 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703568:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787864930.703572:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703579:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.703582:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703589:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703599:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703607:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3d8f823/0x2fcb8c294dc44868 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703620:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.703624:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703636:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.703640:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703648:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703659:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703666:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000861ed507/0x2fcb8c294dc4486f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.703679:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.703681:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.703682:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.703688:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.703692:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.703810:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.703817:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703833:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.703836:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.703840:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703848:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703856:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703862:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.703884:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.704341:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.704347:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.704357:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796e00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.704361:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.704382:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.704395:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.704403:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44876 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.704417:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.704419:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.704420:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.704710:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.704717:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.704726:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.704730:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.704735:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.704746:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.704766:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.704774:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.704796:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.705198:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.705203:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.705212:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796c00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.705216:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.705225:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.705249:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.705267:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079707fe5/0x2fcb8c294dc4487d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.705282:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.705284:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.705286:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.705417:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.705422:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.705430:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.705433:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.705437:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.705446:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.705455:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.705462:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.705492:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787864930.705923:0:17070:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.705930:0:17070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.706058:0:17070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.706072:0:17070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.706083:0:17070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.706095:0:17070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.706103:0:17070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009730182a/0x2fcb8c294dc44884 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.706118:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.706120:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.706121:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787864930.706569:0:18590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787864930.706576:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.706587:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=455s v=(0 0) 00010000:00010000:1.0:1787864930.706591:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864930.706596:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.706606:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.706615:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.706623:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864930.707164:0:18590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787864930.707213:0:18590:0:(ofd_dev.c:1522:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1787864930.707315:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17108:x1874711844932480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 49792us (51825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.707326:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787864930.707513:0:17108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17108:1874711844932480:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787864930.707534:0:17108:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1787864930.707577:0:17108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17108:1874711844933504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787864930.707612:0:17108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.707643:0:17108:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548aea480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864930.707766:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933504 00000100:00100000:2.0:1787864930.707772:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933504 00000100:00100000:2.0:1787864930.707812:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864930.707820:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17108:x1874711844933504:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787864930.707850:0:18740:0:(ofd_dev.c:1751:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1787864930.707958:0:18236:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864930.707964:0:18236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.707975:0:18236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797000 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864930.707979:0:18236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.707989:0:18236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.708005:0:18236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.708013:0:18236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3cb4d2/0x2fcb8c294dc4488b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.708031:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.708033:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864930.708034:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787864930.713344:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787864930.713351:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9275777b0800 from 10 10000000:01000000:2.0:1787864930.713355:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787864930.713398:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.713410:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864930.713420:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864930.713444:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864930.713510:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864930.713559:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757bd203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787864930.713581:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933632 00000100:00100000:2.0:1787864930.713587:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933632 00000100:00100000:3.0:1787864930.714446:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864930.714459:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844933632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864930.714473:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864930.714488:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92744824fe00/0x2fcb8c294dc44899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44892 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.714511:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92744824fe00/0x2fcb8c294dc44899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44892 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.714522:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92744824fe00/0x2fcb8c294dc44899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44892 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.714531:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92744824fe00, rc 0) 00000100:00100000:3.0:1787864930.714582:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844933632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864930.714589:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787864930.714648:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a95680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864930.714664:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44899 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864930.714673:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44899 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864930.714738:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787864930.714769:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864930.714793:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff927548aea600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864930.714854:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933760 00000100:00100000:0.0:1787864930.714861:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933760 00000100:00100000:0.0:1787864930.714926:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787864930.714935:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844933760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787864930.714950:0:17076:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787864930.714966:0:17076:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787864930.714970:0:17076:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787864930.715082:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844933760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864930.715089:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787864930.715128:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787864930.715194:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864930.715202:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44899 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715210:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927540030800/0x2fcb8c294dc44892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44899 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864930.715220:0:17078:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787864930.715223:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92754c99c000 from 10 10000000:01000000:0.0:1787864930.715226:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787864930.715258:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715274:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715282:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864930.715299:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787864930.715393:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.715422:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757651d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864930.715437:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844933888 00000100:00100000:0.0:1787864930.715441:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844933888 00000100:00100000:0.0:1787864930.715468:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787864930.715476:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844933888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864930.715484:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864930.715495:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5baa00/0x2fcb8c294dc448a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc448a0 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715521:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5baa00/0x2fcb8c294dc448a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc448a0 expref: 24 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715530:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5baa00/0x2fcb8c294dc448a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc448a0 expref: 24 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715536:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5baa00, rc 0) 00000100:00100000:0.0:1787864930.715570:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844933888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864930.715577:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787864930.715614:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844933888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787864930.715628:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc448a7 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.715636:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc448a7 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864930.715681:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844934016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787864930.715936:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.715961:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275490dd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787864930.715977:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934016 00000100:00100000:0.0:1787864930.715981:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934016 00000100:00100000:0.0:1787864930.716009:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787864930.716017:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844934016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787864930.716029:0:17073:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787864930.716043:0:17073:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787864930.716050:0:17073:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787864930.716136:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844934016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864930.716143:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787864930.716176:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844934016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787864930.716212:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787864930.716217:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc448a7 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864930.716224:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92754c5ba800/0x2fcb8c294dc448a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc448a7 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864930.718799:0:19401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1787864930.718814:0:19401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787864930.718846:0:19401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787864930.718851:0:19401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787864930.720486:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17826:x1874711844933248:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46900us (46964us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787864930.720499:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787864930.720549:0:17826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1787864930.720558:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a94b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17826:1874711844933248:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787864930.720574:0:17826:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787864930.720624:0:17826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17826:1874711844934144:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787864930.720660:0:17826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864930.720679:0:17826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9275490dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1787864930.721416:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274481852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17108:x1874711844933504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13594us (13802us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787864930.721425:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864930.724192:0:17108:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787864930.724206:0:17108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17108:1874711844933504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787864930.724221:0:17108:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:1.0:1787864930.725006:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934144 00000100:00100000:1.0:1787864930.725028:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934144 00000100:00100000:1.0:1787864930.725089:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864930.725101:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17826:x1874711844934144:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787864930.725192:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17826:x1874711844934144:12345-0@lo:900:osp-pre-1-1.0 Request processed in 95us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864930.725201:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787864930.725434:0:17826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92757dbb9680 x1874711844934144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787864946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864930.725448:0:17826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17826:1874711844934144:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1787864931.245504:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864931.609094:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864931.609116:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844934272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864931.609192:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864931.609248:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934272 00000100:00100000:1.0:1787864931.609254:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934272 00000100:00100000:1.0:1787864931.609298:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787864931.609426:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844934400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864931.609455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864931.609487:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934400 00000100:00100000:2.0:1787864931.609491:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934400 00000100:00100000:2.0:1787864931.609509:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864931.609521:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844934400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787864931.609551:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787864931.609589:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a94b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844934400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864931.609608:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787864931.609646:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844934400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864931.611418:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844934272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864931.611459:0:17822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864931.611538:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844934272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2231us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864931.611546:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787864931.611779:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844934272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787864932.250391:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864933.273078:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787864934.298469:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864934.681530:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864934.681554:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844934528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864934.681625:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864934.681802:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934528 00000100:00100000:0.0:1787864934.681810:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934528 00000100:00100000:0.0:1787864934.681869:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787864934.681878:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844934528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864934.681923:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864934.681966:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844934528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864934.681973:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787864934.682210:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864934.682273:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844934528:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787864935.161807:0:19759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg636-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787864935.322232:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864935.706194:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844934656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787864935.706273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706321:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844935168:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706350:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706373:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844935680:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706392:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706407:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844936192:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706470:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787864935.706476:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844934784:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706503:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706520:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844935296:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706540:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706568:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844935808:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706602:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844936320:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706626:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706649:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844935040:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706672:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706687:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844935552:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706722:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844936064:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706751:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787864935.706756:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844934912:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706778:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706794:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844935424:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706813:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706825:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448864780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844935936:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.706843:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864935.706863:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935168 00000100:00100000:1.0:1787864935.706874:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935168 00000100:00100000:1.0:1787864935.706937:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935680 00000100:00100000:1.0:1787864935.706940:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935680 00000100:00100000:1.0:1787864935.706956:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935040 00000100:00100000:1.0:1787864935.706958:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935040 00000100:00100000:1.0:1787864935.706967:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935552 00000100:00100000:1.0:1787864935.706970:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935552 00000100:00100000:1.0:1787864935.706984:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864935.706992:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844935168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707051:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844935168:12345-0@lo:400:kworker.0 Request processed in 59us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707059:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787864935.707074:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864935.707080:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844935680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707106:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844935680:12345-0@lo:400:kworker.0 Request processed in 27us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707112:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787864935.707122:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864935.707127:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844935040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707155:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844935040:12345-0@lo:400:kworker.0 Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707161:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787864935.707171:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864935.707176:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844935552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707199:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844935552:12345-0@lo:400:kworker.0 Request processed in 23us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707205:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787864935.707228:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936192 00000100:00100000:1.0:1787864935.707232:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936192 00000100:00100000:1.0:1787864935.707251:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935296 00000100:00100000:1.0:1787864935.707254:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935296 00000100:00100000:1.0:1787864935.707263:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935808 00000100:00100000:1.0:1787864935.707265:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935808 00000100:00100000:1.0:1787864935.707273:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936320 00000100:00100000:1.0:1787864935.707276:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936320 00000100:00100000:1.0:1787864935.707286:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936064 00000100:00100000:1.0:1787864935.707288:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936064 00000100:00100000:1.0:1787864935.707297:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935936 00000100:00100000:1.0:1787864935.707299:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935936 00000100:00100000:1.0:1787864935.707311:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864935.707317:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844936192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707346:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844936192:12345-0@lo:400:kworker.0 Request processed in 29us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707352:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787864935.707362:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787864935.707368:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844935296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707391:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874711844935296:12345-0@lo:400:kworker.0 Request processed in 23us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707396:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787864935.707406:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864935.707411:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844935808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707447:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874711844935808:12345-0@lo:400:kworker.0 Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707453:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787864935.707464:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864935.707470:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844936320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707502:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448867c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874711844936320:12345-0@lo:400:kworker.0 Request processed in 32us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707508:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787864935.707518:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864935.707524:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844936064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707547:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844936064:12345-0@lo:400:kworker.0 Request processed in 23us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707552:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787864935.707562:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864935.707567:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844935936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707590:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844935936:12345-0@lo:400:kworker.0 Request processed in 22us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707595:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787864935.707618:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934912 00000100:00100000:1.0:1787864935.707622:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934912 00000100:00100000:1.0:1787864935.707641:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844935424 00000100:00100000:1.0:1787864935.707644:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844935424 00000100:00100000:1.0:1787864935.707655:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864935.707660:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844934912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707689:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844934912:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707695:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787864935.707705:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787864935.707711:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844935424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707734:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274488652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844935424:12345-0@lo:400:kworker.0 Request processed in 24us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864935.707748:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787864935.707790:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844934912:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707800:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844935424:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.707810:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448864780 x1874711844935936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.707821:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448864780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844935936:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707832:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844935040:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707841:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844935552:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.707850:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448866d00 x1874711844936064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.707859:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844936064:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.707931:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927447c92580 x1874711844935296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.707941:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874711844935296:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.707950:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448bfde00 x1874711844935808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.707958:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874711844935808:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.707968:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448866580 x1874711844936320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.707976:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3637:1874711844936320:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.707996:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844935168:0@lo:400:kworker.0 00000100:00100000:1.0:1787864935.708006:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448bfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844935680:0@lo:400:kworker.0 00010000:00080000:1.0:1787864935.708015:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927448864000 x1874711844936192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864935.708023:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448864000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844936192:0@lo:400:kworker.0 00000100:00080000:2.0:1787864935.708866:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864935.708872:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787864935.708875:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864935.708877:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864935.709046:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934656 00000100:00100000:0.0:1787864935.709051:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934656 00000100:00100000:0.0:1787864935.709086:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864935.709094:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448865e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844934656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864935.709111:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864935.709165:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448865e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844934656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.709172:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787864935.709192:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844934784 00000100:00100000:0.0:1787864935.709195:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844934784 00000100:00100000:0.0:1787864935.709232:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787864935.709238:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3637:x1874711844934784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864935.709267:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3637:x1874711844934784:12345-0@lo:400:kworker.0 Request processed in 30us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.709274:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787864935.709307:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864935.709319:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844936448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864935.709348:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864935.709384:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936448 00000100:00100000:0.0:1787864935.709388:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936448 00000100:00100000:0.0:1787864935.709407:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864935.709412:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844936448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864935.709427:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864935.709456:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844936448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864935.709462:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864935.709493:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844936448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864935.709518:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844934784:0@lo:400:kworker.0 00000100:00100000:0.0:1787864935.709531:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927447c930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844934656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864935.712868:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787864935.712914:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844936576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864935.712978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864935.713833:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936576 00000100:00100000:3.0:1787864935.713843:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936576 00000100:00100000:3.0:1787864935.713917:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864935.713926:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844936576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787864935.713948:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1787864935.714003:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844936576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864935.714010:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787864935.714065:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844936576:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1787864935.906726:0:19811:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787864935.907165:0:19811:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787864936.346417:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787864936.624418:0:19861:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787864936.624704:0:19861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787864936.729331:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864936.729355:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844936704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864936.729416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787864936.730011:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787864936.730090:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936704 00000100:00100000:1.0:1787864936.730096:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936704 00000100:00100000:1.0:1787864936.730210:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787864936.730219:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844936704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864936.730455:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864936.730515:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844936704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 297us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864936.730522:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864936.730854:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844936704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864936.733572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844936832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787864936.733643:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864936.733796:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936832 00000100:00100000:0.0:1787864936.733803:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936832 00000100:00100000:0.0:1787864936.733852:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787864936.733861:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844936832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864936.733912:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787864936.733957:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844936832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864936.733964:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864936.735343:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844936832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864936.862529:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864936.862806:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989376 00000100:00100000:3.0:1787864936.862817:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989376 00000100:00100000:3.0:1787864936.862866:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:3.0:1787864936.862873:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1874711825989376:12345-192.168.206.36@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787864936.862975:0:17075:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d616e35a-a6b8-4ca2-b094-37881626c931@192.168.206.36@tcp t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:3.0:1787864936.863004:0:17075:0:(genops.c:1385:class_connect()) connect: client d616e35a-a6b8-4ca2-b094-37881626c931, cookie 0x2fcb8c294dc448ae 00000100:00080000:3.0:1787864936.863148:0:17075:0:(import.c:65:import_set_state_nolock()) ffff927447e16000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864936.863298:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+5:2406:x1874711825989376:12345-192.168.206.36@tcp:250:mount.lustre.0 Request processed in 423us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864936.863307:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 113 00000100:00100000:0.0:1787864936.868155:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864936.868256:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989504 00000100:00100000:2.0:1787864936.868264:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989504 00000100:00100000:2.0:1787864936.868362:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 114 00000100:00100000:2.0:1787864936.868373:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+5:14906:x1874711825989504:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787864936.868391:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864936.868408:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031c00/0x2fcb8c294dc448b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd06 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.868434:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031c00/0x2fcb8c294dc448b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd06 expref: 6 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.868446:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031c00/0x2fcb8c294dc448b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd06 expref: 6 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.868455:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031c00, rc 0) 00000100:00100000:2.0:1787864936.868524:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+6:14906:x1874711825989504:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 152us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864936.868531:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 114 00000100:00100000:3.0:1787864936.878884:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864936.879300:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989632 00000100:00100000:0.0:1787864936.879309:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989632 00000100:00100000:0.0:1787864936.879373:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 115 00000100:00100000:0.0:1787864936.879382:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+6:14906:x1874711825989632:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787864936.879522:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+6:14906:x1874711825989632:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 140us (647us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787864936.879530:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 115 00000100:00100000:1.0:1787864936.888595:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864936.888695:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989760 00000100:00100000:2.0:1787864936.888715:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989760 00000100:00100000:2.0:1787864936.888777:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:2.0:1787864936.888786:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+6:14906:x1874711825989760:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787864936.888802:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864936.888821:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031200/0x2fcb8c294dc448bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd0d expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.888848:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031200/0x2fcb8c294dc448bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd0d expref: 7 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.888859:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031200/0x2fcb8c294dc448bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd0d expref: 7 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.888867:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031200, rc 0) 00000100:00100000:2.0:1787864936.888955:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+7:14906:x1874711825989760:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864936.888963:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 116 00000100:00100000:1.0:1787864936.891111:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864936.891193:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825989888 00000100:00100000:0.0:1787864936.891208:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825989888 00000100:00100000:0.0:1787864936.891259:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 117 00000100:00100000:0.0:1787864936.891268:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+7:14906:x1874711825989888:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787864936.891425:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+8:14906:x1874711825989888:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864936.891434:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 117 00000100:00100000:3.0:1787864936.893114:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864936.893197:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990016 00000100:00100000:2.0:1787864936.893203:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990016 00000100:00100000:2.0:1787864936.893249:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 118 00000100:00100000:2.0:1787864936.893257:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+8:14906:x1874711825990016:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787864936.893384:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+8:14906:x1874711825990016:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864936.893400:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 118 00000100:00100000:1.0:1787864936.909519:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864936.909662:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990144 00000100:00100000:2.0:1787864936.909671:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990144 00000100:00100000:2.0:1787864936.909742:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 119 00000100:00100000:2.0:1787864936.909751:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990144:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864936.909947:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990144:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 196us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864936.909956:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 119 00000100:00100000:1.0:1787864936.960648:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864936.960747:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990272 00000100:00100000:3.0:1787864936.960757:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990272 00000100:00100000:3.0:1787864936.960812:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 120 00000100:00100000:3.0:1787864936.960821:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990272:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787864936.960993:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dafc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990272:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 172us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864936.961001:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 120 00000100:00100000:3.0:1787864936.966613:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864936.968571:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990400 00000100:00100000:0.0:1787864936.968583:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990400 00000100:00100000:0.0:1787864936.968640:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:0.0:1787864936.968648:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757daff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990400:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864936.968789:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757daff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+8:14925:x1874711825990400:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 141us (2183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864936.968797:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 121 00000100:00100000:1.0:1787864936.975782:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864936.975874:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990528 00000100:00100000:2.0:1787864936.975883:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990528 00000100:00100000:2.0:1787864936.975956:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:2.0:1787864936.975964:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+8:14906:x1874711825990528:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787864936.975979:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864936.975995:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540030000/0x2fcb8c294dc448c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd3e expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.976020:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540030000/0x2fcb8c294dc448c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd3e expref: 9 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.976042:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540030000/0x2fcb8c294dc448c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd3e expref: 9 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864936.976052:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030000, rc 0) 00000100:00100000:2.0:1787864936.976107:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+9:14906:x1874711825990528:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864936.976113:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 122 00000100:00100000:1.0:1787864936.981821:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864936.981921:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990656 00000100:00100000:3.0:1787864936.981931:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990656 00000100:00100000:3.0:1787864936.982050:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 123 00000100:00100000:3.0:1787864936.982061:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+9:14906:x1874711825990656:12345-192.168.206.36@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787864936.982085:0:17075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787864936.982108:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787864936.982112:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787864936.982115:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787864936.982118:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787864936.982120:0:17075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787864936.991945:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+9:14906:x1874711825990656:12345-192.168.206.36@tcp:256:mount.lustre.0 Request processed in 9876us (10125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864936.991960:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 123 00000100:00100000:1.0:1787864936.999980:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864937.000065:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990784 00000100:00100000:2.0:1787864937.000073:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990784 00000100:00100000:2.0:1787864937.000124:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 124 00000100:00100000:2.0:1787864937.000132:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+9:14906:x1874711825990784:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787864937.000146:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864937.000162:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd45 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.000187:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 10 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.000198:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 10 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.000207:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031400, rc 0) 00000100:00100000:2.0:1787864937.000336:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+10:14906:x1874711825990784:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 204us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.000344:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 124 00000100:00100000:1.0:1787864937.006429:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.006604:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825990912 00000100:00100000:0.0:1787864937.006614:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825990912 00000100:00100000:0.0:1787864937.006672:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 125 00000100:00100000:0.0:1787864937.006682:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+10:14906:x1874711825990912:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787864937.008428:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+10:14906:x1874711825990912:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 1739us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.008441:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 125 00000100:00100000:3.0:1787864937.014183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.014438:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991040 00000100:00100000:0.0:1787864937.014450:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991040 00000100:00100000:0.0:1787864937.014529:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 126 00000100:00100000:0.0:1787864937.014553:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+10:14906:x1874711825991040:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787864937.014768:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+10:14906:x1874711825991040:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 224us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.014777:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 126 00000100:00100000:1.0:1787864937.026539:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.026653:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991168 00000100:00100000:0.0:1787864937.026669:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991168 00000100:00100000:0.0:1787864937.026741:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 127 00000100:00100000:0.0:1787864937.026752:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744883ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+10:14933:x1874711825991168:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864937.026980:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744883ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+10:14933:x1874711825991168:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 229us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864937.026990:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 127 00000100:00100000:1.0:1787864937.038344:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864937.038663:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991296 00000100:00100000:2.0:1787864937.038684:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991296 00000100:00100000:2.0:1787864937.038754:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 128 00000100:00100000:2.0:1787864937.038766:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+10:14933:x1874711825991296:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864937.039051:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+10:14933:x1874711825991296:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 285us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.039060:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 128 00000100:00100000:0.0:1787864937.057759:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.058004:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864937.058547:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991424 00000100:00100000:1.0:1787864937.058560:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991424 00000100:00100000:3.0:1787864937.058691:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991680 00000100:00100000:3.0:1787864937.058704:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991680 00000100:00100000:3.0:1787864937.058760:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:3.0:1787864937.058768:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1874711825991424:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787864937.058797:0:18198:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 510ff884-8326-4099-a028-24c7f160ea8a@192.168.206.36@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1787864937.058847:0:18198:0:(genops.c:1385:class_connect()) connect: client 510ff884-8326-4099-a028-24c7f160ea8a, cookie 0x2fcb8c294dc448d1 00000100:00100000:2.0:1787864937.058853:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:2.0:1787864937.058864:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1874711825991680:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787864937.058950:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 510ff884-8326-4099-a028-24c7f160ea8a@192.168.206.36@tcp t0 exp 0000000000000000 cur 462 last 0 00000004:00100000:3.0:1787864937.058992:0:18198:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 77 00000020:00000080:2.0:1787864937.059071:0:17083:0:(genops.c:1385:class_connect()) connect: client 510ff884-8326-4099-a028-24c7f160ea8a, cookie 0x2fcb8c294dc448d8 00000004:00100000:2.0:1787864937.059098:0:17083:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 77 00000100:00080000:3.0:1787864937.059282:0:18198:0:(import.c:65:import_set_state_nolock()) ffff927447e14000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864937.059368:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:2406:x1874711825991424:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 597us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864937.059376:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00080000:2.0:1787864937.059870:0:17083:0:(import.c:65:import_set_state_nolock()) ffff927441e29000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864937.060047:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+6:2406:x1874711825991680:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 1107us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.060059:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:0.0:1787864937.065499:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.065555:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.065593:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864937.066364:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991936 00000100:00100000:2.0:1787864937.066364:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991808 00000100:00100000:3.0:1787864937.066377:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991936 00000100:00100000:2.0:1787864937.066377:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991808 00000100:00100000:1.0:1787864937.067913:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825991552 00000100:00100000:1.0:1787864937.067928:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825991552 00000100:00100000:1.0:1787864937.068010:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:3.0:1787864937.068135:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864937.068150:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+7:0:x1874711825991552:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787864937.068228:0:18198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787864937.068354:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+7:0:x1874711825991552:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 210us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864937.068363:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864937.068387:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864937.068395:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825991936:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787864937.068406:0:18198:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787864937.068428:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825991936:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 35us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864937.068434:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:1.0:1787864937.068812:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:0:x1874711825991808:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787864937.068851:0:17081:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787864937.068929:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:0:x1874711825991808:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 909us (3374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864937.068937:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00080000:0.0:1787864937.069322:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864937.069329:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864937.071174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864937.071325:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992064 00000100:00100000:1.0:1787864937.071336:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992064 00000100:00100000:1.0:1787864937.071406:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:1.0:1787864937.071418:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992064:12345-192.168.206.36@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787864937.071790:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992064:12345-192.168.206.36@tcp:40:mount.lustre.0 Request processed in 372us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864937.071800:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:3.0:1787864937.075786:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864937.076143:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992448 00000100:00100000:2.0:1787864937.076155:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992448 00000100:00100000:2.0:1787864937.076226:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:2.0:1787864937.076238:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992448:12345-192.168.206.36@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787864937.076390:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992448:12345-192.168.206.36@tcp:900:mount.lustre.0 Request processed in 154us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.076399:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:0.0:1787864937.076852:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864937.077008:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864937.077297:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992192 00000100:00100000:2.0:1787864937.077304:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992192 00000100:00100000:2.0:1787864937.077343:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992320 00000100:00100000:2.0:1787864937.077347:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992320 00000100:00100000:2.0:1787864937.077373:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:2.0:1787864937.077380:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1874711825992192:12345-192.168.206.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787864937.077414:0:18589:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 510ff884-8326-4099-a028-24c7f160ea8a@192.168.206.36@tcp t0 exp 0000000000000000 cur 462 last 0 00000100:00100000:3.0:1787864937.077417:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:3.0:1787864937.077423:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1874711825992320:12345-192.168.206.36@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787864937.077447:0:18591:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 510ff884-8326-4099-a028-24c7f160ea8a@192.168.206.36@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787864937.077451:0:18589:0:(genops.c:1385:class_connect()) connect: client 510ff884-8326-4099-a028-24c7f160ea8a, cookie 0x2fcb8c294dc448df 00002000:00100000:2.0:1787864937.077464:0:18589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 510ff884-8326-4099-a028-24c7f160ea8a/ffff927441e2b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1787864937.077466:0:18591:0:(genops.c:1385:class_connect()) connect: client 510ff884-8326-4099-a028-24c7f160ea8a, cookie 0x2fcb8c294dc448e6 00002000:00100000:3.0:1787864937.077470:0:18591:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 510ff884-8326-4099-a028-24c7f160ea8a/ffff92754be0e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787864937.077497:0:18591:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 77 00002000:00100000:2.0:1787864937.077641:0:18589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 77 00002000:00080000:3.0:1787864937.077728:0:18591:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787864937.077764:0:18591:0:(import.c:65:import_set_state_nolock()) ffff92754be0b000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1787864937.077807:0:18589:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787864937.077824:0:18589:0:(import.c:65:import_set_state_nolock()) ffff927441e2e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787864937.077828:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:510ff884-8326-4099-a028-24c7f160ea8a+6:2406:x1874711825992320:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 403us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864937.077836:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:2.0:1787864937.077847:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:2406:x1874711825992192:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 467us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.077854:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:1.0:1787864937.096757:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864937.096964:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992576 00000100:00100000:3.0:1787864937.096976:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992576 00000100:00100000:3.0:1787864937.097399:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:3.0:1787864937.097411:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992576:12345-192.168.206.36@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787864937.100458:0:17084:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2900us 00000004:00200000:3.0:1787864937.124504:0:17084:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787864937.124622:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+6:14906:x1874711825992576:12345-192.168.206.36@tcp:33:mount.lustre.0 Request processed in 27209us (27874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864937.124632:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:3.0:1787864937.291373:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864937.291523:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992704 00000100:00100000:2.0:1787864937.291533:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992704 00000100:00100000:2.0:1787864937.291607:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:2.0:1787864937.291617:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:14956:x1874711825992704:12345-192.168.206.36@tcp:101:mkdir.0 00010000:00010000:2.0:1787864937.291636:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864937.291661:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc448ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd76 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291729:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291742:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291757:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864937.291808:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787864937.291812:0:17082:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864937.291870:0:17082:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291925:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc448ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd76 expref: 8 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291952:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd76 expref: 7 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864937.291960:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:2.0:1787864937.291963:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864937.291966:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387a400, rc 0) 00000100:00100000:2.0:1787864937.292041:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+7:14956:x1874711825992704:12345-192.168.206.36@tcp:101:mkdir.0 Request processed in 426us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864937.292048:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 13 00010000:00010000:3.0:1787864937.369286:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787864938.393915:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787864938.841599:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864939.117047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.117137:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992832 00000100:00100000:2.0:1787864939.117145:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992832 00000100:00100000:2.0:1787864939.117225:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:2.0:1787864939.117234:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+7:15008:x1874711825992832:12345-192.168.206.36@tcp:41:lfs.0 00000004:00000024:2.0:1787864939.117270:0:17083:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787864939.117353:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+7:15008:x1874711825992832:12345-192.168.206.36@tcp:41:lfs.0 Request processed in 120us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.117360:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00080000:0.0:1787864939.117414:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787864939.119360:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.119464:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825992960 00000100:00100000:2.0:1787864939.119472:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825992960 00000100:00100000:2.0:1787864939.119658:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:2.0:1787864939.119668:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825992960:12345-192.168.206.36@tcp:41:lfs.0 00000004:00000024:2.0:1787864939.119700:0:17082:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787864939.119807:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825992960:12345-192.168.206.36@tcp:41:lfs.0 Request processed in 140us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.119814:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00080000:0.0:1787864939.121508:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787864939.124160:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.124644:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993088 00000100:00100000:0.0:1787864939.124654:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993088 00000100:00100000:0.0:1787864939.124730:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:0.0:1787864939.124740:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825993088:12345-192.168.206.36@tcp:13:lfs.0 00002000:00000024:0.0:1787864939.124770:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864939.124919:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dc16940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825993088:12345-192.168.206.36@tcp:13:lfs.0 Request processed in 180us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.124926:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00080000:2.0:1787864939.126101:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787864939.129375:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.129574:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993216 00000100:00100000:0.0:1787864939.129590:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993216 00000100:00100000:0.0:1787864939.129752:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:0.0:1787864939.129764:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825993216:12345-192.168.206.36@tcp:13:lfs.0 00000100:00080000:2.0:1787864939.129784:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787864939.129806:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864939.130325:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:510ff884-8326-4099-a028-24c7f160ea8a+6:15008:x1874711825993216:12345-192.168.206.36@tcp:13:lfs.0 Request processed in 560us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.130337:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864939.259804:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.260083:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993344 00000100:00100000:2.0:1787864939.260095:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993344 00000100:00100000:2.0:1787864939.260177:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:2.0:1787864939.260189:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+10:15041:x1874711825993344:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787864939.260216:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864939.260242:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92755387a200/0x2fcb8c294dc448fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acd7d expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.260416:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92755387a200/0x2fcb8c294dc448fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd7d expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.260440:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92755387a200/0x2fcb8c294dc448fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd7d expref: 11 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864939.260452:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92755387a200, rc 0) 00000100:00100000:2.0:1787864939.260526:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825993344:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 339us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.260533:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 129 00000100:00100000:3.0:1787864939.266508:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.266689:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993472 00000100:00100000:0.0:1787864939.266698:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993472 00000100:00100000:0.0:1787864939.266758:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00100000:0.0:1787864939.266768:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825993472:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787864939.266930:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825993472:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 163us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.266950:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 130 00000100:00100000:3.0:1787864939.268717:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.269300:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993600 00000100:00100000:2.0:1787864939.269309:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993600 00000100:00100000:2.0:1787864939.269368:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:2.0:1787864939.269380:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825993600:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787864939.269654:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825993600:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 276us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.269662:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 131 00000100:00100000:3.0:1787864939.279518:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.279829:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993728 00000100:00100000:2.0:1787864939.279849:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993728 00000100:00100000:2.0:1787864939.279924:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:2.0:1787864939.279933:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993728:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864939.280072:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993728:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 140us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.280081:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 132 00000100:00100000:3.0:1787864939.296502:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.296699:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993856 00000100:00100000:2.0:1787864939.296708:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993856 00000100:00100000:2.0:1787864939.296767:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 133 00000100:00100000:2.0:1787864939.296778:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993856:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787864939.296960:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993856:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 183us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.296968:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 133 00000100:00100000:3.0:1787864939.300205:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.304306:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825993984 00000100:00100000:0.0:1787864939.304321:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825993984 00000100:00100000:0.0:1787864939.304826:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 134 00000100:00100000:0.0:1787864939.305424:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993984:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864939.306383:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+11:15047:x1874711825993984:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 1543us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.306394:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 134 00000100:00100000:3.0:1787864939.315115:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.315278:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994112 00000100:00100000:0.0:1787864939.315286:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994112 00000100:00100000:0.0:1787864939.315345:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 135 00000100:00100000:0.0:1787864939.315355:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+11:15041:x1874711825994112:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787864939.315370:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864939.315388:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5bb800/0x2fcb8c294dc44902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acdae expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.315415:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5bb800/0x2fcb8c294dc44902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdae expref: 12 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.315427:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5bb800/0x2fcb8c294dc44902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdae expref: 12 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.315437:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb800, rc 0) 00000100:00100000:0.0:1787864939.315491:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+12:15041:x1874711825994112:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 137us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.315497:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 135 00000100:00100000:3.0:1787864939.318714:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.318854:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994240 00000100:00100000:0.0:1787864939.318862:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994240 00000100:00100000:0.0:1787864939.318961:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 136 00000100:00100000:0.0:1787864939.318971:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+12:15041:x1874711825994240:12345-192.168.206.36@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787864939.318995:0:17075:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787864939.319029:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787864939.319033:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787864939.319036:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787864939.319039:0:17075:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787864939.319042:0:17075:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787864939.320627:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+12:15041:x1874711825994240:12345-192.168.206.36@tcp:256:mount.lustre.0 Request processed in 1650us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.320640:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 136 00000100:00100000:3.0:1787864939.328511:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.328717:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994368 00000100:00100000:0.0:1787864939.328726:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994368 00000100:00100000:0.0:1787864939.328946:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 137 00000100:00100000:0.0:1787864939.328956:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+12:15041:x1874711825994368:12345-192.168.206.36@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787864939.328973:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864939.328991:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acdb5 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.329026:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 13 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.329037:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 13 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864939.329047:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bac00, rc 0) 00000100:00100000:0.0:1787864939.329121:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:15041:x1874711825994368:12345-192.168.206.36@tcp:101:mount.lustre.0 Request processed in 166us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.329129:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 137 00000100:00100000:3.0:1787864939.332454:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.332558:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994496 00000100:00100000:0.0:1787864939.332567:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994496 00000100:00100000:0.0:1787864939.332627:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 138 00000100:00100000:0.0:1787864939.332637:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:15041:x1874711825994496:12345-192.168.206.36@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787864939.332878:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:15041:x1874711825994496:12345-192.168.206.36@tcp:501:mount.lustre.0 Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.332886:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 138 00000100:00100000:3.0:1787864939.341149:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.341656:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994624 00000100:00100000:0.0:1787864939.341733:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994624 00000100:00100000:0.0:1787864939.342008:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 139 00000100:00100000:0.0:1787864939.342028:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:15041:x1874711825994624:12345-192.168.206.36@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787864939.342319:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:15041:x1874711825994624:12345-192.168.206.36@tcp:503:mount.lustre.0 Request processed in 299us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.342329:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 139 00000100:00100000:3.0:1787864939.345550:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.345723:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994752 00000100:00100000:0.0:1787864939.345732:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994752 00000100:00100000:0.0:1787864939.345828:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:0.0:1787864939.345837:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:15051:x1874711825994752:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787864939.346026:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:15051:x1874711825994752:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 180us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.346033:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 140 00000100:00100000:3.0:1787864939.349504:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864939.349652:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825994880 00000100:00100000:1.0:1787864939.349660:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825994880 00000100:00100000:1.0:1787864939.349719:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 141 00000100:00100000:1.0:1787864939.349730:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:15051:x1874711825994880:12345-192.168.206.36@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787864939.349932:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d861050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:15051:x1874711825994880:12345-192.168.206.36@tcp:502:llog_process_th.0 Request processed in 203us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.349940:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 141 00000100:00100000:3.0:1787864939.358491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864939.358596:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.359006:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995008 00000100:00100000:2.0:1787864939.359024:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995008 00000100:00100000:2.0:1787864939.359061:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995264 00000100:00100000:2.0:1787864939.359065:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995264 00000100:00100000:2.0:1787864939.359088:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:2.0:1787864939.359096:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1874711825995008:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787864939.359122:0:17083:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4@192.168.206.36@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787864939.359160:0:17083:0:(genops.c:1385:class_connect()) connect: client 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4, cookie 0x2fcb8c294dc44910 00000004:00100000:2.0:1787864939.359193:0:17083:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 77 00000100:00080000:2.0:1787864939.359277:0:17083:0:(import.c:65:import_set_state_nolock()) ffff92757dca2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864939.359340:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2406:x1874711825995008:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 243us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.359348:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:1.0:1787864939.360862:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:1.0:1787864939.360871:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1874711825995264:12345-192.168.206.36@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787864939.360931:0:17081:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4@192.168.206.36@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:1.0:1787864939.360968:0:17081:0:(genops.c:1385:class_connect()) connect: client 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4, cookie 0x2fcb8c294dc44917 00000004:00100000:1.0:1787864939.361000:0:17081:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 77 00000100:00080000:1.0:1787864939.361090:0:17081:0:(import.c:65:import_set_state_nolock()) ffff92755fbe8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787864939.361142:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2406:x1874711825995264:12345-192.168.206.36@tcp:38:mount.lustre.0 Request processed in 269us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.361150:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:0.0:1787864939.363013:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.363108:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.363207:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.363232:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.363260:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995776 00000100:00100000:0.0:1787864939.363280:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995776 00000100:00100000:0.0:1787864939.363326:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995904 00000100:00100000:0.0:1787864939.363329:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995904 00000100:00100000:0.0:1787864939.363351:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:0.0:1787864939.363359:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995776:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864939.363421:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995776:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 63us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.363427:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:0.0:1787864939.363441:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864939.363447:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995904:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864939.363486:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995904:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 38us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.363492:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864939.363513:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995520 00000100:00100000:0.0:1787864939.363516:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995520 00000100:00100000:0.0:1787864939.364102:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995648 00000100:00100000:0.0:1787864939.364107:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995648 00000100:00100000:0.0:1787864939.364122:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:0.0:1787864939.364128:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+7:2410:x1874711825995520:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864939.364161:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+7:2410:x1874711825995520:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 33us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.364168:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:0.0:1787864939.364192:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:0.0:1787864939.364199:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995648:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864939.364222:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711825995648:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.364235:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:0.0:1787864939.370549:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.370789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864939.370942:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995136 00000100:00100000:1.0:1787864939.370951:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995136 00000100:00100000:1.0:1787864939.371033:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825995392 00000100:00100000:1.0:1787864939.371037:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825995392 00000100:00100000:1.0:1787864939.371064:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:1.0:1787864939.371072:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:0:x1874711825995136:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787864939.371100:0:17082:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864939.371164:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:0:x1874711825995136:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 92us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.371171:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:1.0:1787864939.371199:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864939.371206:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:0:x1874711825995392:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787864939.371233:0:17082:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787864939.371259:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:0:x1874711825995392:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 53us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.371264:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00080000:2.0:1787864939.371805:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787864939.371810:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787864939.380383:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864939.380461:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996032 00000100:00100000:1.0:1787864939.380481:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996032 00000100:00100000:1.0:1787864939.380586:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864939.380597:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996032:12345-192.168.206.36@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787864939.380625:0:17082:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864939.380693:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996032:12345-192.168.206.36@tcp:41:mount.lustre.0 Request processed in 98us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.380701:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864939.390365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.390648:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996160 00000100:00100000:0.0:1787864939.390656:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996160 00000100:00100000:0.0:1787864939.390710:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:0.0:1787864939.390719:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996160:12345-192.168.206.36@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787864939.390806:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996160:12345-192.168.206.36@tcp:40:mount.lustre.0 Request processed in 88us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.390813:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:0.0:1787864939.401435:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.401490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.401528:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864939.401560:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996288 00000100:00100000:0.0:1787864939.401568:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996288 00000100:00100000:0.0:1787864939.401599:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996416 00000100:00100000:0.0:1787864939.401602:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996416 00000100:00100000:0.0:1787864939.401618:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:0.0:1787864939.401626:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2406:x1874711825996288:12345-192.168.206.36@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787864939.401744:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:2.0:1787864939.401752:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2406:x1874711825996416:12345-192.168.206.36@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787864939.401769:0:18740:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4@192.168.206.36@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787864939.401800:0:18740:0:(genops.c:1385:class_connect()) connect: client 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4, cookie 0x2fcb8c294dc4491e 00002000:00100000:2.0:1787864939.401810:0:18740:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4/ffff92757dca4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787864939.401821:0:18740:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 77 00002000:00080000:2.0:1787864939.401927:0:18740:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787864939.401957:0:18740:0:(import.c:65:import_set_state_nolock()) ffff92757dca7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787864939.402141:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2406:x1874711825996416:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 386us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.402149:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864939.403266:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996544 00000100:00100000:1.0:1787864939.403275:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996544 00000100:00100000:1.0:1787864939.403325:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:1.0:1787864939.403334:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996544:12345-192.168.206.36@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787864939.403398:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996544:12345-192.168.206.36@tcp:900:mount.lustre.0 Request processed in 65us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.403405:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00010000:00080000:0.0:1787864939.403624:0:18590:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4@192.168.206.36@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1787864939.403656:0:18590:0:(genops.c:1385:class_connect()) connect: client 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4, cookie 0x2fcb8c294dc44925 00002000:00100000:0.0:1787864939.403665:0:18590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4/ffff92757c3ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787864939.403674:0:18590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 77 00002000:00080000:0.0:1787864939.403737:0:18590:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787864939.403775:0:18590:0:(import.c:65:import_set_state_nolock()) ffff92757c3ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787864939.403804:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757fb69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2406:x1874711825996288:12345-192.168.206.36@tcp:8:mount.lustre.0 Request processed in 2179us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864939.403812:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00010000:00010000:2.0:1787864939.421802:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864939.434163:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864939.434449:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996672 00000100:00100000:2.0:1787864939.434459:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996672 00000100:00100000:2.0:1787864939.434687:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:2.0:1787864939.434698:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996672:12345-192.168.206.36@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787864939.434775:0:17085:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787864939.434863:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15041:x1874711825996672:12345-192.168.206.36@tcp:33:mount.lustre.0 Request processed in 167us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.434871:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:2.0:1787864939.678999:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864939.679594:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996800 00000100:00100000:1.0:1787864939.679605:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996800 00000100:00100000:1.0:1787864939.679678:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:1.0:1787864939.679689:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15074:x1874711825996800:12345-192.168.206.36@tcp:101:mkdir.0 00010000:00010000:1.0:1787864939.679709:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864939.679744:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc4492c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acde6 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.679803:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.679816:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.679828:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864939.679885:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787864939.680096:0:17081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864939.680123:0:17081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.680152:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc4492c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 8 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.680169:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864939.680178:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:1.0:1787864939.680181:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864939.680185:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796800, rc 0) 00000100:00100000:1.0:1787864939.680468:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a95680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+7:15074:x1874711825996800:12345-192.168.206.36@tcp:101:mkdir.0 Request processed in 780us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864939.680477:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:3.0:1787864939.810105:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844936960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787864939.810181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864939.810356:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844936960 00000100:00100000:2.0:1787864939.810363:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844936960 00000100:00100000:2.0:1787864939.810471:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787864939.810476:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864939.810495:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844936960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787864939.810516:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787864939.810574:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844936960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864939.810580:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864939.810669:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844936960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787864940.453728:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864940.825605:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864940.825633:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844937088:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787864940.825729:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864940.825811:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937088 00000100:00100000:0.0:1787864940.825820:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937088 00000100:00100000:0.0:1787864940.825914:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787864940.825925:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844937088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864940.825956:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864940.826022:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844937088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.826030:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787864940.826053:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864940.826092:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558aba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844937088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787864940.826386:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864940.826419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.826453:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787864940.826459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844937216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864940.826482:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864940.826761:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937344 00000100:00100000:2.0:1787864940.826766:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937344 00000100:00100000:2.0:1787864940.826801:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937216 00000100:00100000:2.0:1787864940.826805:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937216 00000100:00100000:2.0:1787864940.826821:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864940.826829:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844937344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787864940.826844:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1787864940.826881:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844937344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864940.826909:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864940.826923:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864940.826929:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844937216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787864940.826940:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1787864940.826969:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844937216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864940.826975:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787864940.826989:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787864940.826992:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864940.827003:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844937856:0@lo:400:kworker.0 00000100:00100000:2.0:1787864940.827048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864940.827070:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844938368:0@lo:400:kworker.0 00000100:00100000:2.0:1787864940.827104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864940.827156:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844937216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864940.827325:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844937472:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827360:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827386:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844937984:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827428:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844938496:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827465:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787864940.827470:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844937600:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827494:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827513:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844938112:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827552:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844938624:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864940.827613:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937856 00000100:00100000:3.0:1787864940.827618:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937856 00000100:00100000:3.0:1787864940.827647:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938368 00000100:00100000:3.0:1787864940.827658:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938368 00000100:00100000:3.0:1787864940.827684:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938496 00000100:00100000:3.0:1787864940.827686:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938496 00000100:00100000:3.0:1787864940.827699:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938112 00000100:00100000:3.0:1787864940.827701:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938112 00000100:00100000:3.0:1787864940.827712:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938624 00000100:00100000:3.0:1787864940.827714:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938624 00000100:00100000:3.0:1787864940.827729:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864940.827735:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827774:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844937856:12345-0@lo:400:kworker.0 Request processed in 39us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.827780:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787864940.827797:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787864940.827802:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827829:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874711844938368:12345-0@lo:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.827835:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787864940.827845:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864940.827851:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844938496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827880:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874711844938496:12345-0@lo:400:kworker.0 Request processed in 30us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.827885:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787864940.827918:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864940.827923:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844938112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.827951:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844938112:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.827956:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787864940.827979:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864940.827985:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844938624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.828027:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844938624:12345-0@lo:400:kworker.0 Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864940.828032:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787864940.828064:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92754cf830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844938112:0@lo:400:kworker.0 00010000:00080000:3.0:1787864940.828078:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcf840 x1874711844938624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864940.828088:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844938624:0@lo:400:kworker.0 00000100:00100000:3.0:1787864940.828099:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3639:1874711844938496:0@lo:400:kworker.0 00000100:00080000:3.0:1787864940.828142:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787864940.828146:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864940.831269:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937472 00000100:00100000:0.0:1787864940.831289:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937472 00000100:00100000:0.0:1787864940.831386:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787864940.831399:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3639:x1874711844937472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.831517:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d863050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3639:x1874711844937472:12345-0@lo:400:kworker.0 Request processed in 120us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.831547:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787864940.831634:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448186580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:af099440-ba6e-4600-a03b-1ca45ea8912e:3639:1874711844937472:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.831752:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937984 00000100:00100000:0.0:1787864940.831756:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937984 00000100:00100000:0.0:1787864940.831786:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937600 00000100:00100000:0.0:1787864940.831789:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937600 00000100:00100000:0.0:1787864940.831804:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864940.831809:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844937984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.831853:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844937984:12345-0@lo:400:kworker.0 Request processed in 43us (4441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.831860:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864940.831872:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864940.831877:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844937600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.831934:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844937600:12345-0@lo:400:kworker.0 Request processed in 57us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.831940:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787864940.831964:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844937728:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832000:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864940.832039:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844938240:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832067:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864940.832104:0:19485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844937728 00000100:00100000:0.0:1787864940.832107:0:19485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844937728 00000100:00100000:0.0:1787864940.832132:0:19485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864940.832138:0:19485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844937728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832168:0:19485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844937728:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.832197:0:19485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787864940.832228:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558996940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844937728:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832254:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844937600:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832264:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844937984:0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832289:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938240 00000100:00100000:0.0:1787864940.832292:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938240 00000100:00100000:0.0:1787864940.832328:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864940.832333:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844938240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864940.832367:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874711844938240:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864940.832373:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787864940.832396:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3637:1874711844938240:0@lo:400:kworker.0 00000100:00080000:0.0:1787864940.832414:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864940.832504:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844937344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864940.832546:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558997840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844937856:0@lo:400:kworker.0 00010000:00080000:2.0:1787864940.832561:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcfc00 x1874711844938368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787864940.832572:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3638:1874711844938368:0@lo:400:kworker.0 00010000:00010000:1.0:1787864941.465629:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864941.849656:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787864941.849680:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448864780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844938752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787864941.849753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864941.849885:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844938880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864941.849930:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864941.849996:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938752 00000100:00100000:0.0:1787864941.850014:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938752 00000100:00100000:0.0:1787864941.850060:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844938880 00000100:00100000:0.0:1787864941.850063:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844938880 00000100:00100000:0.0:1787864941.850083:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787864941.850093:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844938752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787864941.850124:0:17822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864941.853468:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787864941.853488:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844938880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864941.853621:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844938752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3528us (3866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864941.853629:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00000024:1.0:1787864941.853757:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787864941.853816:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844938880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 336us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864941.853822:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787864941.855392:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448864780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844938752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787864941.855425:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844938880:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1787864942.162619:0:19959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787864942.489121:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787864942.875757:0:19401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4 00000001:00100000:0.0:1787864942.875767:0:19401:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 510ff884-8326-4099-a028-24c7f160ea8a 00000001:00100000:3.0:1787864942.875978:0:18585:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4 00000001:00100000:3.0:1787864942.875985:0:18585:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 510ff884-8326-4099-a028-24c7f160ea8a 00000001:00100000:1.0:1787864942.879401:0:17061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4 00000001:00100000:1.0:1787864942.879413:0:17061:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 510ff884-8326-4099-a028-24c7f160ea8a 00000001:00100000:0.0:1787864942.882181:0:17814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4 00000001:00100000:0.0:1787864942.882192:0:17814:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 510ff884-8326-4099-a028-24c7f160ea8a 00010000:00010000:3.0:1787864943.513098:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864944.537095:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787864944.733980:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864944.734021:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864944.734045:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864944.734071:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864944.734092:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997056 00000100:00100000:1.0:1787864944.734099:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864944.734101:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997056 00000100:00100000:1.0:1787864944.734117:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864944.734135:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864944.734156:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864944.734170:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997568 00000100:00100000:1.0:1787864944.734176:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864944.734177:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997568 00000100:00100000:1.0:1787864944.734203:0:19486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997312 00000100:00100000:3.0:1787864944.734204:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997184 00000100:00100000:3.0:1787864944.734209:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997184 00000100:00100000:1.0:1787864944.734209:0:19486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997312 00000100:00100000:3.0:1787864944.734227:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997696 00000100:00100000:3.0:1787864944.734231:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997696 00000100:00100000:1.0:1787864944.734247:0:19486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997824 00000100:00100000:1.0:1787864944.734252:0:19486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997824 00000100:00100000:3.0:1787864944.734260:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:1.0:1787864944.734274:0:19486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997440 00000100:00100000:3.0:1787864944.734283:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+6:2409:x1874711825997056:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864944.734286:0:19486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997440 00000100:00100000:1.0:1787864944.734306:0:19486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825997952 00000100:00100000:1.0:1787864944.734309:0:19486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825997952 00000100:00100000:1.0:1787864944.734323:0:19486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:1.0:1787864944.734331:0:19486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997312:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864944.734361:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+6:2409:x1874711825997056:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 80us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864944.734368:0:19486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997312:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864944.734375:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:1.0:1787864944.734380:0:19486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:1.0:1787864944.734400:0:19486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:3.0:1787864944.734406:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:1.0:1787864944.734409:0:19486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997824:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864944.734420:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2409:x1874711825997568:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864944.734435:0:19486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997824:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864944.734442:0:19486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:1.0:1787864944.734457:0:19486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:3.0:1787864944.734458:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2409:x1874711825997568:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864944.734466:0:19486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997440:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864944.734471:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:3.0:1787864944.734490:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:1.0:1787864944.734495:0:19486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997440:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864944.734502:0:19486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:1.0:1787864944.734515:0:19486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:3.0:1787864944.734520:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997184:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864944.734525:0:19486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997952:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864944.734557:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711825997184:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 40us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864944.734564:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:3.0:1787864944.734577:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864944.734585:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997696:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:2.0:1787864944.734602:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825996928 00000100:00100000:2.0:1787864944.734607:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825996928 00000100:00080000:0.0:1787864944.734648:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787864944.734652:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787864944.734654:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787864944.734656:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864944.734758:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 143 00000100:00100000:2.0:1787864944.734765:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+13:2409:x1874711825996928:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864944.734815:0:19486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997952:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 292us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864944.734825:0:19486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 12 00000100:00100000:3.0:1787864944.734826:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711825997696:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 239us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864944.734838:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:3.0:1787864944.737477:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d862450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+13:2409:x1874711825996928:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 2704us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864944.737490:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 143 00000100:00100000:0.0:1787864944.926515:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864944.926539:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787864944.926618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864944.926853:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939008 00000100:00100000:0.0:1787864944.926860:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939008 00000100:00080000:1.0:1787864944.926927:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864944.926949:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787864944.926959:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864944.927001:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864944.927055:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864944.927064:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787864944.927096:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787864945.562173:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864945.945840:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864945.945931:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.945988:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939648:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.946013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.946032:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844940160:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.946054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.946068:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844940672:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.946089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.946122:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787864945.946128:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939520:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946335:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939136 00000100:00100000:0.0:1787864945.946342:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939136 00000100:00100000:0.0:1787864945.946392:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864945.946402:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787864945.946430:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864945.946470:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.946478:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787864945.946512:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844939392:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946542:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946573:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844939904:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946614:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844940416:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946632:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946643:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844940928:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946665:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946684:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787864945.946690:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844939264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864945.946707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946720:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844939776:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946752:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844940288:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946785:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844940800:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.946818:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.946844:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939264 00000100:00100000:0.0:1787864945.946848:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939264 00000100:00100000:0.0:1787864945.946868:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864945.946873:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844939264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787864945.946915:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864945.946946:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844939264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.946952:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787864945.946970:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939392 00000100:00100000:0.0:1787864945.946975:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939392 00000100:00100000:0.0:1787864945.947009:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787864945.947022:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3638:x1874711844939392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.947054:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3638:x1874711844939392:12345-0@lo:400:kworker.0 Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.947060:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787864945.947083:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940672 00000100:00100000:0.0:1787864945.947087:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940672 00000100:00100000:0.0:1787864945.947119:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939904 00000100:00100000:0.0:1787864945.947122:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939904 00000100:00100000:0.0:1787864945.947136:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940416 00000100:00100000:0.0:1787864945.947138:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940416 00000100:00100000:0.0:1787864945.949359:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940928 00000100:00100000:0.0:1787864945.949369:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940928 00000100:00100000:0.0:1787864945.949403:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940800 00000100:00100000:0.0:1787864945.949405:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940800 00000100:00100000:0.0:1787864945.949424:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787864945.949432:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844940672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787864945.949679:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864945.949684:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787864945.949687:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864945.949689:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864945.949701:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844941056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864945.952822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.952911:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844940032:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.952970:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.953002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844940544:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.953027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864945.953071:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787864945.953104:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939648 00000100:00100000:2.0:1787864945.953110:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939648 00000100:00100000:2.0:1787864945.956335:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940160 00000100:00100000:2.0:1787864945.956348:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940160 00000100:00100000:2.0:1787864945.956404:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939776 00000100:00100000:2.0:1787864945.956408:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939776 00000100:00100000:2.0:1787864945.956419:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940288 00000100:00100000:2.0:1787864945.956421:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940288 00000100:00100000:2.0:1787864945.956451:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864945.956460:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956561:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939648:12345-0@lo:400:kworker.0 Request processed in 101us (10546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956568:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787864945.956584:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864945.956591:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844940160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956621:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844940160:12345-0@lo:400:kworker.0 Request processed in 30us (10565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956626:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787864945.956637:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864945.956657:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844939776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956688:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844939776:12345-0@lo:400:kworker.0 Request processed in 33us (9950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956693:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787864945.956704:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864945.956710:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844940288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956738:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1874711844940288:12345-0@lo:400:kworker.0 Request processed in 28us (9965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956743:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787864945.956769:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940544 00000100:00100000:2.0:1787864945.956773:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940544 00000100:00100000:2.0:1787864945.956796:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864945.956803:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844939904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956832:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874711844939904:12345-0@lo:400:kworker.0 Request processed in 29us (10235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956839:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787864945.956851:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864945.956857:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844940416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956885:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874711844940416:12345-0@lo:400:kworker.0 Request processed in 28us (10252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956908:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787864945.956920:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864945.956927:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844940928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.956956:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874711844940928:12345-0@lo:400:kworker.0 Request processed in 30us (10291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.956971:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864945.956994:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864945.957002:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844940800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.957031:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874711844940800:12345-0@lo:400:kworker.0 Request processed in 30us (10212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.957035:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864945.957046:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864945.957052:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844940544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.957079:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874711844940544:12345-0@lo:400:kworker.0 Request processed in 28us (4051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864945.957085:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864945.957125:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3640:1874711844940544:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.957138:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939648:0@lo:400:kworker.0 00000100:00100000:2.0:1787864945.957271:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844940160:0@lo:400:kworker.0 00000100:00100000:3.0:1787864945.958251:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844939520 00000100:00100000:3.0:1787864945.958263:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844939520 00000100:00100000:3.0:1787864945.958298:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844940032 00000100:00100000:3.0:1787864945.958301:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844940032 00000100:00100000:3.0:1787864945.958313:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864945.958319:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864945.958376:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874711844939520:12345-0@lo:400:kworker.0 Request processed in 57us (5562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864945.958383:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787864945.958395:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787864945.958400:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787864945.958421:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874711844940032:12345-0@lo:400:kworker.0 Request processed in 22us (5451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864945.958427:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787864945.958458:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3640:1874711844939520:0@lo:400:kworker.0 00000100:00100000:3.0:1787864945.958470:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3640:1874711844940032:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959457:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874711844940672:12345-0@lo:400:kworker.0 Request processed in 10021us (13364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864945.959467:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787864945.959560:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844939264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787864945.959574:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844939776:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3638:1874711844940288:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959594:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3638:1874711844940800:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959604:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:af099440-ba6e-4600-a03b-1ca45ea8912e:3638:1874711844939392:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959615:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874711844939904:0@lo:400:kworker.0 00000100:00100000:0.0:1787864945.959637:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874711844940416:0@lo:400:kworker.0 00010000:00080000:0.0:1787864945.959650:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcf840 x1874711844940928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787864945.959660:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3638:1874711844940928:0@lo:400:kworker.0 00000100:00080000:0.0:1787864945.959724:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787864945.959730:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787864945.959879:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcd680 x1874711844940672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864945.959913:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3640:1874711844940672:0@lo:400:kworker.0 00000100:00100000:1.0:1787864945.965326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864945.972124:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941056 00000100:00100000:0.0:1787864945.972137:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941056 00000100:00100000:1.0:1787864945.977650:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787864945.977663:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844941056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787864945.977689:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1787864945.978247:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844941056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 585us (12927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864945.978256:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787864945.982404:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844941056:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1787864946.055464:0:20107:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6551ad70 20000000:00000080:3.0:1787864946.055481:0:20107:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff927446f0a800 uarg=0000000000000000 20000000:01000000:3.0:1787864946.055523:0:20107:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787864946.055529:0:20107:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787864946.055533:0:20107:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787864946.056260:0:20108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787864946.056410:0:20107:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787864946.061527:0:20107:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787864946.061559:0:20107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061590:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061598:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 23 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061605:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061613:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061622:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 12 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061628:0:20107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061635:0:20107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061674:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061689:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.061703:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941184:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864946.061803:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 12 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061818:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 12 pid: 17076 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.061827:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941312:192.168.206.36@tcp:104: 00010000:00010000:3.0:1787864946.061861:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.061869:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 23 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.061877:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941440:0@lo:104: 00000100:00100000:3.0:1787864946.061950:0:20107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864946.061996:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.062005:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 23 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.062013:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941568:0@lo:104: 00000100:00100000:3.0:1787864946.062036:0:20107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864946.062069:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 23 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.062077:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 23 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.062084:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448866d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941696:0@lo:104: 00000100:00100000:3.0:1787864946.062106:0:20107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787864946.062130:0:20107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.062137:0:20107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 23 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.062408:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941440 00000100:00100000:0.0:1787864946.062415:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941440 00000100:00100000:0.0:1787864946.062452:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941568 00000100:00100000:0.0:1787864946.062455:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941568 00000100:00100000:0.0:1787864946.062465:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941696 00000100:00100000:0.0:1787864946.062467:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941696 00000100:00100000:0.0:1787864946.062479:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864946.062487:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+5:20107:x1874711844941440:12345-0@lo:104: 00010000:00010000:0.0:1787864946.062499:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062547:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864946.062553:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+5:20107:x1874711844941440:12345-0@lo:104: Request processed in 67us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.062559:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864946.062575:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864946.062582:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+4:20107:x1874711844941568:12345-0@lo:104: 00010000:00010000:0.0:1787864946.062589:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062638:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787864946.062642:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+4:20107:x1874711844941568:12345-0@lo:104: Request processed in 62us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.062648:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864946.062659:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787864946.062663:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:20107:x1874711844941696:12345-0@lo:104: 00010000:00010000:0.0:1787864946.062670:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062695:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787864946.062699:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:20107:x1874711844941696:12345-0@lo:104: Request processed in 36us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.062704:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787864946.062717:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787864946.062722:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062729:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031600 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864946.062732:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062740:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864946.062747:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864946.062753:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864946.062783:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062788:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864946.062807:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062814:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540031600/0x2fcb8c294dc44773 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4477a expref: -99 pid: 19400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062826:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787864946.062829:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062834:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864946.062837:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062843:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864946.062849:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864946.062854:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864946.062864:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062869:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864946.062880:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062919:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff927540030200/0x2fcb8c294dc44615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc4461c expref: -99 pid: 18584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062927:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864946.062930:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062935:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d948a00 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864946.062938:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062944:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864946.062949:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864946.062954:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864946.062965:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062970:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864946.062976:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.062993:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d948a00/0x2fcb8c294dc445d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445dd expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063000:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.063006:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.063007:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.063014:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.063018:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864946.063036:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844941952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.063064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864946.063099:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844942080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.063120:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864946.063137:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787864946.063143:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844942208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787864946.063227:0:20107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941824:0@lo:104: 00000100:00100000:3.0:1787864946.063251:0:20107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864946.063266:0:20107:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757d864600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864946.063288:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941440:0@lo:104: 00000100:00100000:3.0:1787864946.063295:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941568:0@lo:104: 00000100:00100000:3.0:1787864946.063302:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448866d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941696:0@lo:104: 00000100:00100000:0.0:1787864946.063363:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864946.063399:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941952 00000100:00100000:0.0:1787864946.063403:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941952 00010000:00010000:0.0:1787864946.063419:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 24 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.063433:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942080 00000100:00100000:0.0:1787864946.063435:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942080 00010000:00010000:0.0:1787864946.063444:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 25 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.063454:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942208 00000100:00100000:0.0:1787864946.063456:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942208 00010000:00010000:0.0:1787864946.063465:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 26 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.063476:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864946.063481:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+26:3640:x1874711844941952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864946.063492:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864946.063502:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 26 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063511:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 26 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063524:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92754c5bb200/0x2fcb8c294dc4477a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44773 expref: 26 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063535:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864946.063564:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+25:3640:x1874711844941952:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.063570:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787864946.063582:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864946.063588:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558997840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3637:x1874711844942080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864946.063595:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864946.063599:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 24 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063607:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 24 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063616:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92744824e200/0x2fcb8c294dc4461c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc44615 expref: 24 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063624:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864946.063649:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558997840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:3637:x1874711844942080:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.063654:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787864946.063665:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787864946.063678:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+22:3637:x1874711844942208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864946.063686:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864946.063691:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 22 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063699:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 22 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063708:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030400/0x2fcb8c294dc445dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc445d6 expref: 22 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063716:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864946.063737:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:3637:x1874711844942208:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.063742:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787864946.063772:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558ab9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844941952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.063797:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844942208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.063804:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558abbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844942080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.063819:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844941824 00000100:00100000:0.0:1787864946.063822:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844941824 00000100:00100000:0.0:1787864946.063839:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787864946.063845:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:20107:x1874711844941824:12345-0@lo:104: 00010000:00010000:0.0:1787864946.063853:0:17064:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063883:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787864946.063908:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92754cf830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:af099440-ba6e-4600-a03b-1ca45ea8912e+3:20107:x1874711844941824:12345-0@lo:104: Request processed in 64us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.063919:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787864946.063933:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787864946.063937:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063944:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757d949000 already unused, calling callback (ffffffffc13d3c20) 10000000:00010000:0.0:1787864946.063947:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.063955:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787864946.063962:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787864946.063967:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787864946.064001:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.064007:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787864946.064017:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.064023:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.136@tcp lock: ffff92757d949000/0x2fcb8c294dc445c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2fcb8c294dc445cf expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.064035:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.064037:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787864946.064038:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864946.064047:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787864946.064060:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844942336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.064084:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864946.064106:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942336 00000100:00100000:0.0:1787864946.064110:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942336 00010000:00010000:0.0:1787864946.064123:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 21 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.064141:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787864946.064262:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927448a943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941824:0@lo:104: 00000100:00100000:0.0:1787864946.065677:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558996940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:3640:x1874711844942336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787864946.065691:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864946.065697:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 21 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.065708:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 21 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.065722:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540030e00/0x2fcb8c294dc445cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2fcb8c294dc445c8 expref: 21 pid: 17075 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.065735:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864946.065795:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558996940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:3640:x1874711844942336:12345-0@lo:103:ldlm_bl.0 Request processed in 1648us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864946.065802:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787864946.065938:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558994780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:af099440-ba6e-4600-a03b-1ca45ea8912e:3640:1874711844942336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787864946.068125:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa4f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941184:192.168.206.36@tcp:104: 00000100:00100000:0.0:1787864946.068138:0:20107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927446fa61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20107:1874711844941312:192.168.206.36@tcp:104: 00010000:00010000:0.0:1787864946.068310:0:20107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864946.070580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864946.070677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864946.070922:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998208 00000100:00100000:3.0:1787864946.070931:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998208 00010000:00010000:3.0:1787864946.070968:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 13 pid: 17076 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.071010:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998080 00000100:00100000:3.0:1787864946.071013:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998080 00010000:00010000:3.0:1787864946.071025:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 14 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864946.071038:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:3.0:1787864946.071046:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d616e35a-a6b8-4ca2-b094-37881626c931+14:2410:x1874711825998208:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864946.071058:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864946.071063:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 14 pid: 17076 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071083:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 14 pid: 17076 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071101:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031400/0x2fcb8c294dc448ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd45 expref: 14 pid: 17076 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071115:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864946.071191:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c58050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d616e35a-a6b8-4ca2-b094-37881626c931+13:2410:x1874711825998208:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 136us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864946.071199:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 13 00000100:00100000:3.0:1787864946.071242:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 14 00000100:00100000:3.0:1787864946.071248:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558994780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d616e35a-a6b8-4ca2-b094-37881626c931+12:2410:x1874711825998080:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864946.071254:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864946.071258:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071267:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071277:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92754c5bac00/0x2fcb8c294dc44909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdb5 expref: 12 pid: 17073 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071287:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071294:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071317:0:17066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071322:0:17066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071328:0:17066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071333:0:17066:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071339:0:17066:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540031800 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:3.0:1787864946.071342:0:17066:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071349:0:17066:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071359:0:17066:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864946.071368:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864946.071396:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558994780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d616e35a-a6b8-4ca2-b094-37881626c931+11:2410:x1874711825998080:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 148us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864946.071402:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 14 00010000:00010000:0.0:1787864946.072513:0:20107:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.072526:0:20107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864946.072533:0:20107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff927540031800/0x2fcb8c294dc4493a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864946.585916:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864946.969059:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787864946.969082:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844942464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787864946.969147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864946.969299:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942464 00000100:00100000:3.0:1787864946.969307:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942464 00000100:00100000:3.0:1787864946.969357:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787864946.969367:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844942464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787864946.969407:0:17822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787864946.969456:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558996940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844942464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864946.969464:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787864946.969509:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927558995a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844942464:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787864946.970249:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864946.970417:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844942592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787864946.970461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864946.970610:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942592 00000100:00100000:1.0:1787864946.970615:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942592 00000100:00100000:1.0:1787864946.970653:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787864946.970660:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844942592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787864946.970684:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787864946.970718:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558995a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844942592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864946.970724:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787864946.970780:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844942592:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787864947.608992:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787864947.680594:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787864947.680602:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92755fbeb800 from 13 10000000:01000000:2.0:1787864947.680607:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787864947.680652:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.680663:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.680692:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864947.680718:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.680786:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.680830:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864947.681946:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942720 00000100:00100000:2.0:1787864947.681955:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942720 00000100:00100000:2.0:1787864947.682202:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787864947.682213:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+20:17078:x1874711844942720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864947.682302:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864947.682320:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757f7bac00/0x2fcb8c294dc44948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc44941 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.682343:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757f7bac00/0x2fcb8c294dc44948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc44941 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.682354:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757f7bac00/0x2fcb8c294dc44948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc44941 expref: 21 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.682362:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bac00, rc 0) 00000100:00100000:2.0:1787864947.682419:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d860850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844942720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.682426:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787864947.682475:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864947.682492:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44948 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.682508:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44948 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864947.682573:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.682603:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.682630:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac480 going to sleep for 11 seconds 00000100:00100000:2.0:1787864947.682644:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942848 00000100:00100000:2.0:1787864947.682647:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942848 00000100:00100000:2.0:1787864947.682670:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864947.682677:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844942848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.682789:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844942848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.682796:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787864947.682826:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.683672:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.683718:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864947.683742:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac480 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.684334:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844942976 00000100:00100000:3.0:1787864947.684341:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844942976 00000100:00100000:3.0:1787864947.684420:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787864947.684428:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844942976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.684540:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844942976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.684548:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787864947.684627:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844942976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787864947.685549:0:20186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787864947.685915:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787864947.685941:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864947.685949:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44948 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.685983:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff92757f7bbe00/0x2fcb8c294dc44941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44948 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864947.685994:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864947.685996:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92754b00f000 from 13 10000000:01000000:1.0:1787864947.685999:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864947.686027:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.686035:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.686045:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.686076:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.686120:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.693002:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787864947.693232:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943104 00000100:00100000:2.0:1787864947.693240:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943104 00000100:00100000:2.0:1787864947.693289:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787864947.693298:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+21:17078:x1874711844943104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787864947.693316:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864947.693334:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92757f7bba00/0x2fcb8c294dc44956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4494f expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.693373:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92757f7bba00/0x2fcb8c294dc44956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4494f expref: 22 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.693383:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92757f7bba00/0x2fcb8c294dc44956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4494f expref: 22 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864947.693392:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bba00, rc 0) 00000100:00100000:2.0:1787864947.693452:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.693459:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787864947.693607:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.693625:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44956 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.693635:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44956 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.693707:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.693741:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.693776:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.694492:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943232 00000100:00100000:3.0:1787864947.694500:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943232 00000100:00100000:3.0:1787864947.694535:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787864947.694543:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.694672:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.694680:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787864947.694788:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.694824:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.694868:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.694930:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.695081:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943360 00000100:00100000:3.0:1787864947.695086:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943360 00000100:00100000:3.0:1787864947.695106:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787864947.695112:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787864947.695307:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.695321:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787864947.695402:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787864947.696456:0:20187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787864947.699621:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787864947.699656:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787864947.699667:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44956 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.699680:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446796a00/0x2fcb8c294dc4494f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44956 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864947.699689:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864947.699692:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9275777b0800 from 13 10000000:01000000:1.0:1787864947.699695:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864947.699729:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.699736:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.699744:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.699766:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.699828:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.699881:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.699955:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943488 00000100:00100000:3.0:1787864947.699962:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943488 00000100:00100000:3.0:1787864947.700017:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787864947.700026:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+22:17078:x1874711844943488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864947.700037:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864947.700050:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031600/0x2fcb8c294dc44964 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4495d expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.700071:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031600/0x2fcb8c294dc44964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4495d expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.700081:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031600/0x2fcb8c294dc44964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4495d expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.700090:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031600, rc 0) 00000100:00100000:3.0:1787864947.700124:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.700131:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787864947.700352:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.700366:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44964 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.700374:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44964 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.700424:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.700449:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.700476:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.700528:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943616 00000100:00100000:0.0:1787864947.700532:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943616 00000100:00100000:0.0:1787864947.700562:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787864947.700569:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.700679:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.700686:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787864947.701092:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.701123:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.701230:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.701257:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787864947.701302:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943744 00000100:00100000:2.0:1787864947.701307:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943744 00000100:00100000:2.0:1787864947.701338:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787864947.701345:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.701436:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.701443:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787864947.701544:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787864947.702486:0:20188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787864947.705927:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787864947.705990:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787864947.706001:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44964 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864947.706012:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797a00/0x2fcb8c294dc4495d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44964 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787864947.706199:0:17078:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787864947.706204:0:17078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92754c99c000 from 13 10000000:01000000:1.0:1787864947.706207:0:17078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787864947.706243:0:17078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.706252:0:17078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.706262:0:17078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.706295:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.706359:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.706400:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8540 going to sleep for 11 seconds 00000100:00100000:3.0:1787864947.706567:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844943872 00000100:00100000:3.0:1787864947.706573:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844943872 00000100:00100000:3.0:1787864947.706622:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787864947.706631:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+23:17078:x1874711844943872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787864947.706643:0:17075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864947.706655:0:17075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927540031400/0x2fcb8c294dc44972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2fcb8c294dc4496b expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.706676:0:17075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927540031400/0x2fcb8c294dc44972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2fcb8c294dc4496b expref: 24 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.706694:0:17075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927540031400/0x2fcb8c294dc44972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2fcb8c294dc4496b expref: 24 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.706703:0:17075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031400, rc 0) 00000100:00100000:3.0:1787864947.706743:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844943872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864947.706750:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787864947.708276:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844943872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.708298:0:17078:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44972 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.708309:0:17078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2fcb8c294dc44972 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864947.708383:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844944000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.708436:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.708476:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787864947.708722:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844944000 00000100:00100000:0.0:1787864947.708728:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844944000 00000100:00100000:0.0:1787864947.708773:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787864947.708782:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844944000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.708988:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844944000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.708997:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787864947.709008:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844944000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.709039:0:17078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844944128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.709085:0:17078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864947.709113:0:17078:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8540 going to sleep for 11 seconds 00000100:00100000:1.0:1787864947.709131:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844944128 00000100:00100000:1.0:1787864947.709134:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844944128 00000100:00100000:1.0:1787864947.709309:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787864947.709315:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844944128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787864947.709390:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757d9e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af099440-ba6e-4600-a03b-1ca45ea8912e+24:17078:x1874711844944128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.709397:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787864947.709443:0:17078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:af099440-ba6e-4600-a03b-1ca45ea8912e:17078:1874711844944128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787864947.710492:0:20189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787864947.712348:0:17078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787864947.712384:0:17078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.136@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787864947.712395:0:17078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44972 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864947.712408:0:17078:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.136@tcp lock: ffff927446797e00/0x2fcb8c294dc4496b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2fcb8c294dc44972 expref: -99 pid: 17078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864947.946014:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864947.947441:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998336 00000100:00100000:1.0:1787864947.947453:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998336 00000100:00100000:1.0:1787864947.947514:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 157 00000100:00100000:1.0:1787864947.947525:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+11:14920:x1874711825998336:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.947541:0:17073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864947.947561:0:17073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797600/0x2fcb8c294dc44979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acded expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.947587:0:17073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797600/0x2fcb8c294dc44979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acded expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.947599:0:17073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797600/0x2fcb8c294dc44979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acded expref: 12 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.947608:0:17073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797600, rc 0) 00000100:00100000:1.0:1787864947.947669:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998336:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 146us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.947676:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 157 00000100:00100000:3.0:1787864947.950121:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864947.950194:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998464 00000100:00100000:2.0:1787864947.950203:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998464 00000100:00100000:2.0:1787864947.950258:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 158 00000100:00100000:2.0:1787864947.950268:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998464:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787864947.950430:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998464:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 161us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864947.950438:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 158 00000100:00100000:3.0:1787864947.952490:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864947.952605:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998592 00000100:00100000:0.0:1787864947.952612:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998592 00000100:00100000:0.0:1787864947.952661:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:0.0:1787864947.952668:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998592:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.952784:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998592:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 116us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.952792:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 159 00000100:00100000:3.0:1787864947.963129:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864947.963693:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998720 00000100:00100000:1.0:1787864947.963704:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998720 00000100:00100000:1.0:1787864947.963754:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:1.0:1787864947.963764:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+12:14920:x1874711825998720:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787864947.963780:0:17076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864947.963797:0:17076:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff927446797000/0x2fcb8c294dc44980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acdf4 expref: -99 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.963851:0:17076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff927446797000/0x2fcb8c294dc44980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdf4 expref: 13 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.963864:0:17076:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff927446797000/0x2fcb8c294dc44980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdf4 expref: 13 pid: 17076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864947.963873:0:17076:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797000, rc 0) 00000100:00100000:1.0:1787864947.963956:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d616e35a-a6b8-4ca2-b094-37881626c931+13:14920:x1874711825998720:12345-192.168.206.36@tcp:101:ll_cfg_requeue.0 Request processed in 193us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864947.963964:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 160 00000100:00100000:3.0:1787864947.971139:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864947.971687:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998848 00000100:00100000:0.0:1787864947.971698:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998848 00000100:00100000:0.0:1787864947.971753:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 161 00000100:00100000:0.0:1787864947.971763:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:14920:x1874711825998848:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.972626:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:14920:x1874711825998848:12345-192.168.206.36@tcp:501:ll_cfg_requeue.0 Request processed in 859us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.972645:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 161 00000100:00100000:0.0:1787864947.996672:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864947.996713:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825998976 00000100:00100000:0.0:1787864947.996723:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825998976 00000100:00100000:0.0:1787864947.996777:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 162 00000100:00100000:0.0:1787864947.996788:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:14920:x1874711825998976:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787864947.998142:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d616e35a-a6b8-4ca2-b094-37881626c931+13:14920:x1874711825998976:12345-192.168.206.36@tcp:503:ll_cfg_requeue.0 Request processed in 1347us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864947.998154:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 162 00000040:00080000:1.0:1787864948.058374:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787864948.633067:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787864949.231396:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.231509:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999104 00000100:00100000:2.0:1787864949.231518:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999104 00000100:00080000:0.0:1787864949.232092:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864949.232107:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:2.0:1787864949.232118:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+6:15591:x1874711825999104:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864949.232134:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.232153:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acdfb expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232217:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232231:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232243:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232256:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232263:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232270:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232336:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7baa00/0x2fcb8c294dc4499c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232344:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7baa00/0x2fcb8c294dc4499c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232367:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7baa00/0x2fcb8c294dc4499c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.232396:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787864949.232399:0:17082:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864949.232432:0:17082:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7baa00/0x2fcb8c294dc4499c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232442:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232449:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232456:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232462:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.232465:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232472:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232483:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:2.0:1787864949.232485:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.232489:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232495:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc4498e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232515:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232521:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232537:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232542:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.232545:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232552:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232559:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff927448157200) 00010000:00010000:2.0:1787864949.232561:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.232563:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232569:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc44995 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232595:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdfb expref: 8 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232616:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7baa00/0x2fcb8c294dc4499c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acdfb expref: 7 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.232633:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff927448157000) 00010000:00010000:2.0:1787864949.232636:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787864949.232638:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7baa00, rc 0) 00000100:00100000:2.0:1787864949.232695:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+7:15591:x1874711825999104:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 581us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864949.232702:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 23 00000100:00100000:1.0:1787864949.237811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.237937:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999232 00000100:00100000:3.0:1787864949.237946:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999232 00000100:00100000:3.0:1787864949.238016:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:3.0:1787864949.238026:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:510ff884-8326-4099-a028-24c7f160ea8a+7:15591:x1874711825999232:12345-192.168.206.36@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787864949.238111:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:510ff884-8326-4099-a028-24c7f160ea8a+7:15591:x1874711825999232:12345-192.168.206.36@tcp:900:lhsmtool_posix.0 Request processed in 87us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.238119:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:0.0:1787864949.249651:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.249752:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999488 00000100:00100000:2.0:1787864949.249762:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999488 00000100:00100000:2.0:1787864949.249829:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:2.0:1787864949.249838:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+7:15591:x1874711825999488:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864949.249857:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.249877:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace02 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.249999:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250013:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250024:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250083:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250091:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250108:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250280:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba800/0x2fcb8c294dc449b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250289:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba800/0x2fcb8c294dc449b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250295:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba800/0x2fcb8c294dc449b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.250305:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787864949.250455:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250463:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250469:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250475:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.250479:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250485:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250497:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff927448157000) 00010000:00010000:2.0:1787864949.250500:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.250510:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250517:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250530:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250536:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250541:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250546:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.250549:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250554:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250561:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff927448157200) 00010000:00010000:2.0:1787864949.250564:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.250567:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.250572:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.252615:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace02 expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.252662:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba800/0x2fcb8c294dc449b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace02 expref: 9 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.252671:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927448157a00) 00010000:00010000:2.0:1787864949.252673:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.252676:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7ba800, rc 0) 00000100:00100000:2.0:1787864949.252766:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+9:15591:x1874711825999488:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 2928us (3123us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787864949.252775:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:0.0:1787864949.268062:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.268386:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999616 00000100:00100000:2.0:1787864949.268394:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999616 00000100:00100000:2.0:1787864949.268453:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:2.0:1787864949.268462:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+9:15591:x1874711825999616:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787864949.268565:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448a96d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+9:15591:x1874711825999616:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 103us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864949.268573:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:3.0:1787864949.275075:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864949.275221:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999744 00000100:00100000:0.0:1787864949.275230:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999744 00000100:00100000:0.0:1787864949.275296:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:0.0:1787864949.275306:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+5:15591:x1874711825999744:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1787864949.275528:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787864949.282306:0:17083:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6961us 00000100:00100000:0.0:1787864949.293420:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.293641:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711825999872 00000100:00100000:3.0:1787864949.293652:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711825999872 00000100:00100000:3.0:1787864949.293712:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:3.0:1787864949.293721:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448866d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+9:15597:x1874711825999872:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864949.293740:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864949.293773:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc449c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace09 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293829:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293842:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293852:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293865:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293871:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293877:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293941:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293973:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293980:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293986:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030e00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864949.293991:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.293997:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294009:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:3.0:1787864949.294012:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864949.294016:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294021:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc449cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294034:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294038:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294043:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294047:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864949.294056:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294062:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294070:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927566faab00) 00010000:00010000:3.0:1787864949.294072:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864949.294074:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294080:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc449d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294110:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc449c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace09 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294120:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:3.0:1787864949.294122:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864949.294136:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc449c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace09 expref: 10 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.294147:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:3.0:1787864949.294210:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448866d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+9:15597:x1874711825999872:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 490us (799us total) trans 0 rc 301/301 00000100:00100000:3.0:1787864949.294218:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 27 00000100:00100000:3.0:1787864949.298909:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448bffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+5:15591:x1874711825999744:12345-192.168.206.36@tcp:59:lhsmtool_posix.0 Request processed in 23581us (23819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.298923:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:0.0:1787864949.299219:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.299561:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000000 00000100:00100000:3.0:1787864949.299581:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000000 00000100:00100000:3.0:1787864949.299660:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:3.0:1787864949.299671:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:510ff884-8326-4099-a028-24c7f160ea8a+9:15597:x1874711826000000:12345-192.168.206.36@tcp:700:lfs.0 00000100:00100000:3.0:1787864949.299881:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:510ff884-8326-4099-a028-24c7f160ea8a+9:15597:x1874711826000000:12345-192.168.206.36@tcp:700:lfs.0 Request processed in 84us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.299918:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:0.0:1787864949.302010:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.302104:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000256 00000100:00100000:2.0:1787864949.302113:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000256 00000100:00100000:2.0:1787864949.302174:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:2.0:1787864949.302184:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+9:15597:x1874711826000256:12345-192.168.206.36@tcp:36:lfs.0 00010000:00010000:2.0:1787864949.302234:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864949.302259:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92755387a400/0x2fcb8c294dc448f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acd76 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.302283:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:2.0:1787864949.302301:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864949.302360:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.302375:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 5 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.302385:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.302420:0:17081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 5 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.302435:0:17081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 5 pid: 17081 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864949.302452:0:17081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17081:1874711844944256:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864949.302554:0:17081:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787864949.304706:0:17081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17081:1874711844944256:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864949.304731:0:17081:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864949.306623:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.306754:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000384 00000100:00100000:3.0:1787864949.306762:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000384 00010000:00010000:3.0:1787864949.306826:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 6 pid: 17081 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864949.306871:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 15 00000100:00100000:3.0:1787864949.306881:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:2409:x1874711826000384:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864949.306919:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864949.306926:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 6 pid: 17081 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.306939:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 6 pid: 17081 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.306971:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acde6 expref: 6 pid: 17081 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.306986:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:3.0:1787864949.306991:0:17066:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.307014:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.307021:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.307043:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864949.307091:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2409:x1874711826000384:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 211us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.307098:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 15 00010000:00010000:2.0:1787864949.307174:0:17081:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.307193:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.307215:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.307234:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.307243:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787864949.307683:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787864949.309163:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309642:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309656:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864949.309676:0:17081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e64ff9 reply state 00000000a6512a78 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309685:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309692:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864949.309694:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864949.309698:0:17081:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787864949.309703:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787864949.309710:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309717:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309723:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309739:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bae00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.309743:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309751:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309762:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff927448157300) 00010000:00010000:2.0:1787864949.309764:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.309768:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309774:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc449db lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864949.309793:0:17081:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020e64ff9 reply state 00000000a6512a78 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309802:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.309809:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927448157200) 00010000:00010000:2.0:1787864949.309811:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864949.309813:0:17081:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787864949.309938:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+10:15597:x1874711826000256:12345-192.168.206.36@tcp:36:lfs.0 Request processed in 7753us (7934us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787864949.309947:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 28 00000100:00100000:0.0:1787864949.390983:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.391040:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000512 00000100:00100000:1.0:1787864949.391050:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000512 00000100:00100000:1.0:1787864949.391117:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:1.0:1787864949.391127:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+10:15605:x1874711826000512:12345-192.168.206.36@tcp:101:lctl.0 00010000:00010000:1.0:1787864949.391151:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864949.391175:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc449f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace10 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391244:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc449f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391259:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc449f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391270:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc449f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864949.391323:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787864949.391327:0:18198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864949.391365:0:18198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc449f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391391:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc449f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace10 expref: 12 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391407:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797200/0x2fcb8c294dc449f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace10 expref: 11 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.391415:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:1.0:1787864949.391418:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864949.391421:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797200, rc 0) 00000100:00100000:1.0:1787864949.391483:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+11:15605:x1874711826000512:12345-192.168.206.36@tcp:101:lctl.0 Request processed in 357us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.391491:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 29 00000100:00100000:0.0:1787864949.422311:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.422458:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000640 00000100:00100000:3.0:1787864949.422467:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000640 00000100:00100000:3.0:1787864949.422528:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:3.0:1787864949.422537:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:15606:x1874711826000640:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864949.422555:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864949.422589:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc449fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace17 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422650:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422665:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422677:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864949.422725:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787864949.422729:0:17082:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864949.422767:0:17082:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422790:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc449fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace17 expref: 7 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422809:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030400/0x2fcb8c294dc44a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace17 expref: 6 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.422817:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:3.0:1787864949.422819:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787864949.422823:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030400, rc 0) 00000100:00100000:3.0:1787864949.422921:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15606:x1874711826000640:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 384us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.422928:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 30 00000100:00100000:0.0:1787864949.427107:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.427204:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000768 00000100:00100000:1.0:1787864949.427218:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000768 00000100:00100000:1.0:1787864949.427285:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:1.0:1787864949.427296:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+6:15606:x1874711826000768:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864949.427389:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864949.427409:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44a0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace1e expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427468:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427498:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427509:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427521:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427529:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.427536:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428498:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428513:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428522:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864949.428578:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787864949.428583:0:18198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864949.428611:0:18198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428623:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428642:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428649:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.428655:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446797c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864949.428659:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.429957:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.429986:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:1.0:1787864949.429989:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864949.429993:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430000:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44a13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430018:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430024:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430031:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430036:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864949.430052:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430059:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430068:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927448157200) 00010000:00010000:1.0:1787864949.430070:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864949.430074:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430079:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430121:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44a0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace1e expref: 8 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430136:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace1e expref: 7 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.430143:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:1.0:1787864949.430145:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864949.430148:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796400, rc 0) 00000100:00100000:1.0:1787864949.430312:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+7:15606:x1874711826000768:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 3016us (3216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.430322:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 31 00000100:00100000:0.0:1787864949.435940:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.437124:0:17093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826000896 00000100:00100000:3.0:1787864949.437136:0:17093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826000896 00000100:00100000:3.0:1787864949.437273:0:17093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:3.0:1787864949.437285:0:17093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:15606:x1874711826000896:12345-192.168.206.36@tcp:900:lfs.0 00000100:00100000:3.0:1787864949.437393:0:17093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:15606:x1874711826000896:12345-192.168.206.36@tcp:900:lfs.0 Request processed in 110us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.437400:0:17093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00080000:0.0:1787864949.437461:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787864949.446318:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.446528:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826001152 00000100:00100000:3.0:1787864949.446537:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826001152 00000100:00100000:3.0:1787864949.446599:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:3.0:1787864949.446608:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+7:15606:x1874711826001152:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:3.0:1787864949.446632:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864949.446664:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44a28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace25 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864949.446763:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787864949.446854:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44a28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace25 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.446867:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:3.0:1787864949.446870:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787864949.446875:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44a28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace25 expref: 9 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.446933:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:3.0:1787864949.447117:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+8:15606:x1874711826001152:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 509us (808us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787864949.447124:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 32 00000100:00100000:2.0:1787864949.452548:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.452762:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826001408 00000100:00100000:3.0:1787864949.452772:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826001408 00000100:00100000:3.0:1787864949.452831:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:3.0:1787864949.452842:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+8:15606:x1874711826001408:12345-192.168.206.36@tcp:36:lfs.0 00010000:00010000:3.0:1787864949.453125:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864949.453152:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44a21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace1e expref: 8 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.453172:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:3.0:1787864949.453182:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864949.453732:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.453761:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.453773:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864949.454411:0:17083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3027b37 reply state 00000000bb41926b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.454428:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.454449:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864949.454452:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1787864949.454456:0:17083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787864949.454464:0:17083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787864949.454749:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+9:15606:x1874711826001408:12345-192.168.206.36@tcp:36:lfs.0 Request processed in 1906us (2220us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787864949.454759:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 33 00000100:00100000:0.0:1787864949.459456:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.459801:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826001664 00000100:00100000:2.0:1787864949.459811:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826001664 00000100:00100000:2.0:1787864949.459874:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:2.0:1787864949.459884:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+9:15606:x1874711826001664:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864949.460149:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+10:15606:x1874711826001664:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 265us (702us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787864949.460156:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:0.0:1787864949.464746:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.464842:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826001920 00000100:00100000:2.0:1787864949.464851:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826001920 00000100:00100000:2.0:1787864949.464978:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:2.0:1787864949.464989:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+10:15606:x1874711826001920:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864949.465012:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.465031:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace2c expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465096:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465110:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465121:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465145:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465153:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465160:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.465251:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787864949.465315:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465324:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465331:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465343:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.465347:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465355:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465369:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:2.0:1787864949.465372:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.465377:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465384:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465398:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465403:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465409:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465415:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.465418:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465424:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465444:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927448157200) 00010000:00010000:2.0:1787864949.465446:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.465450:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465456:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465486:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace2c expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465496:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:2.0:1787864949.465498:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864949.465502:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace2c expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.465511:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bbc00, rc 0) 00000100:00100000:2.0:1787864949.465849:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+11:15606:x1874711826001920:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 860us (1111us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787864949.465858:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 34 00000100:00100000:0.0:1787864949.473643:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.473787:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002048 00000100:00100000:1.0:1787864949.473796:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002048 00000100:00100000:1.0:1787864949.473856:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:1.0:1787864949.473866:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+11:15606:x1874711826002048:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864949.474826:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864949.474851:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44a59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace33 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475248:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475263:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475274:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864949.475297:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787864949.475301:0:18198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864949.475320:0:18198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475348:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44a59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 13 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475367:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 12 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.475376:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:1.0:1787864949.475379:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787864949.475383:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796000, rc 0) 00000100:00100000:1.0:1787864949.475522:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+12:15606:x1874711826002048:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 1655us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.475530:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 35 00000100:00100000:0.0:1787864949.487228:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.487302:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002176 00000100:00100000:2.0:1787864949.487311:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002176 00000100:00100000:2.0:1787864949.487368:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:2.0:1787864949.487378:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+12:15606:x1874711826002176:12345-192.168.206.36@tcp:37:lfs.0 00000100:00100000:2.0:1787864949.492842:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+12:15606:x1874711826002176:12345-192.168.206.36@tcp:37:lfs.0 Request processed in 5455us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864949.492856:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 3 00000100:00100000:0.0:1787864949.500135:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.500247:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002432 00000100:00100000:3.0:1787864949.500257:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002432 00000100:00100000:3.0:1787864949.500342:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:3.0:1787864949.500353:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+12:15606:x1874711826002432:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:3.0:1787864949.500579:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+13:15606:x1874711826002432:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 227us (453us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787864949.500587:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 4 00000100:00100000:0.0:1787864949.547978:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.548124:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002560 00000100:00100000:2.0:1787864949.548136:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002560 00000100:00100000:2.0:1787864949.548266:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:2.0:1787864949.548278:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+11:15612:x1874711826002560:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864949.548297:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.548317:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace3a expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548376:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548390:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548402:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548413:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548420:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548427:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548506:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba000/0x2fcb8c294dc44a7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548515:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba000/0x2fcb8c294dc44a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548541:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba000/0x2fcb8c294dc44a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.548574:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787864949.548578:0:17081:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787864949.548613:0:17081:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba000/0x2fcb8c294dc44a7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548625:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548632:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548638:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548644:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.548648:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548655:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548666:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:2.0:1787864949.548669:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.548673:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548680:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548703:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548708:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548714:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548719:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.548722:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548728:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548735:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927448157200) 00010000:00010000:2.0:1787864949.548738:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.548740:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548746:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548768:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace3a expref: 13 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548781:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba000/0x2fcb8c294dc44a7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace3a expref: 12 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.548797:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864949.548800:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787864949.548802:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7ba000, rc 0) 00000100:00100000:2.0:1787864949.548874:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+12:15612:x1874711826002560:12345-192.168.206.36@tcp:101:bash.0 Request processed in 598us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864949.548881:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 36 00000100:00100000:0.0:1787864949.553017:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.553139:0:17092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002688 00000100:00100000:1.0:1787864949.553258:0:17092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002688 00000100:00100000:1.0:1787864949.553328:0:17092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:1.0:1787864949.553340:0:17092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:510ff884-8326-4099-a028-24c7f160ea8a+5:15612:x1874711826002688:12345-192.168.206.36@tcp:900:bash.0 00000100:00100000:1.0:1787864949.553452:0:17092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:510ff884-8326-4099-a028-24c7f160ea8a+5:15612:x1874711826002688:12345-192.168.206.36@tcp:900:bash.0 Request processed in 113us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.553461:0:17092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:0.0:1787864949.555995:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.556152:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826002944 00000100:00100000:2.0:1787864949.556163:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826002944 00000100:00100000:2.0:1787864949.556235:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:2.0:1787864949.556247:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+12:15612:x1874711826002944:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:2.0:1787864949.556274:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.556301:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace41 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.556439:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.556457:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 12 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.556631:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.556675:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 12 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.556690:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 12 pid: 18198 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864949.556723:0:17083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17083:1874711844944384:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864949.556865:0:17083:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7acd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787864949.559559:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.559707:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826003072 00000100:00100000:1.0:1787864949.559718:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826003072 00010000:00010000:1.0:1787864949.559767:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 13 pid: 18198 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864949.559815:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 16 00000100:00100000:1.0:1787864949.559826:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+13:2410:x1874711826003072:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864949.559844:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864949.559851:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 13 pid: 18198 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.559866:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 13 pid: 18198 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.559926:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:1.0:1787864949.559933:0:17068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.559946:0:17068:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.559986:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.560010:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864949.560077:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+13:2410:x1874711826003072:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 252us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.560085:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 16 00010000:00010000:2.0:1787864949.561318:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44a60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace33 expref: 12 pid: 18198 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864949.561346:0:17083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17083:1874711844944384:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864949.561374:0:17083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.561385:0:17083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.561391:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.561421:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.561434:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.561444:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562429:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562447:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562548:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.562562:0:17083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787864949.562596:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562603:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562610:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562617:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.562621:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562629:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562643:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864949.562647:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864949.562652:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562658:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44a8a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787864949.562672:0:17083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe807b8 reply state 00000000deb442de transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562695:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562701:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff927448157300) 00010000:00010000:2.0:1787864949.562703:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787864949.562706:0:17083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787864949.562752:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44a83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 15 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562768:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 14 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.562776:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864949.562778:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787864949.562781:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb200, rc 0) 00000100:00100000:2.0:1787864949.562867:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+15:15612:x1874711826002944:12345-192.168.206.36@tcp:101:bash.0 Request processed in 6622us (6883us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787864949.562878:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 37 00000100:00100000:0.0:1787864949.578061:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.578190:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826003200 00000100:00100000:3.0:1787864949.578202:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826003200 00000100:00100000:3.0:1787864949.578327:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:3.0:1787864949.578340:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+15:15612:x1874711826003200:12345-192.168.206.36@tcp:101:bash.0 00010000:00010000:3.0:1787864949.578371:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864949.578399:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44aa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace48 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578486:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578503:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578516:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864949.578583:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787864949.578588:0:17082:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787864949.578614:0:17082:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578628:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578682:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44aa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 17 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578705:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 16 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.578714:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864949.578717:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864949.578721:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540030e00, rc 0) 00000100:00100000:3.0:1787864949.578802:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+16:15612:x1874711826003200:12345-192.168.206.36@tcp:101:bash.0 Request processed in 465us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864949.578810:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 38 00000100:00100000:0.0:1787864949.582354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.582468:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826003456 00000100:00100000:3.0:1787864949.582622:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826003456 00000100:00100000:3.0:1787864949.582697:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:3.0:1787864949.582708:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+16:15612:x1874711826003456:12345-192.168.206.36@tcp:35:bash.0 00000100:00100000:3.0:1787864949.585517:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+17:15612:x1874711826003456:12345-192.168.206.36@tcp:35:bash.0 Request processed in 2798us (3165us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787864949.585533:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 5 00000100:00100000:0.0:1787864949.644753:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.645055:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826003712 00000100:00100000:1.0:1787864949.645075:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826003712 00000100:00100000:1.0:1787864949.645289:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:1.0:1787864949.645303:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+17:15622:x1874711826003712:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:1.0:1787864949.645343:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864949.645377:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace4f expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864949.645624:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787864949.645793:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44ab4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace4f expref: 19 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.645811:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92744810ad00) 00010000:00010000:1.0:1787864949.645820:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787864949.645827:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace4f expref: 19 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.645843:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797800, rc 0) 00000100:00100000:1.0:1787864949.645998:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+18:15622:x1874711826003712:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 697us (1266us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787864949.646034:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 39 00000100:00100000:3.0:1787864949.649969:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.650101:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826003968 00000100:00100000:2.0:1787864949.650114:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826003968 00000100:00100000:2.0:1787864949.651195:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 6 00000100:00100000:2.0:1787864949.651212:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+18:15622:x1874711826003968:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864949.651494:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+19:15622:x1874711826003968:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 287us (1546us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787864949.651502:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 6 00010000:00010000:2.0:1787864949.658410:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864949.698496:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.698736:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004224 00000100:00100000:2.0:1787864949.698748:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004224 00000100:00100000:2.0:1787864949.698859:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:2.0:1787864949.698924:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+19:15625:x1874711826004224:12345-192.168.206.36@tcp:101:lfs.0 00010000:00010000:2.0:1787864949.698957:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864949.698996:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44ac2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace56 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.699195:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44ac9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.699211:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.699224:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864949.699236:0:17081:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787864949.699381:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44ac2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace56 expref: 22 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.699405:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace56 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.699415:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864949.699418:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787864949.699422:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb000, rc 0) 00000100:00100000:2.0:1787864949.699494:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927558ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+21:15625:x1874711826004224:12345-192.168.206.36@tcp:101:lfs.0 Request processed in 624us (1011us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787864949.699523:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 40 00000100:00100000:3.0:1787864949.703743:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.705112:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.705664:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004480 00000100:00100000:1.0:1787864949.705677:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004480 00000100:00100000:0.0:1787864949.705787:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:0.0:1787864949.705802:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+21:2410:x1874711826004480:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787864949.705825:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787864949.705857:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44ac9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace56 expref: 21 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864949.706032:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:0.0:1787864949.706039:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787864949.706109:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+20:2410:x1874711826004480:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 311us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864949.706118:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:2.0:1787864949.706384:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004352 00000100:00100000:2.0:1787864949.706398:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004352 00000100:00100000:2.0:1787864949.706469:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:2.0:1787864949.706478:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+20:15625:x1874711826004352:12345-192.168.206.36@tcp:54:lfs.0 00010000:00010000:2.0:1787864949.706648:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706671:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706685:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706718:0:17083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706726:0:17083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706734:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706740:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864949.706744:0:17083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706752:0:17083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706763:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864949.706778:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864949.706784:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864949.706790:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44ad7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864949.706870:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927448186580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+20:15625:x1874711826004352:12345-192.168.206.36@tcp:54:lfs.0 Request processed in 392us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864949.706878:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 41 00000100:00100000:3.0:1787864949.709415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.709697:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004736 00000100:00100000:2.0:1787864949.709713:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004736 00000100:00100000:2.0:1787864949.709781:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:2.0:1787864949.709791:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+20:15625:x1874711826004736:12345-192.168.206.36@tcp:35:lfs.0 00000100:00100000:2.0:1787864949.710046:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+21:15625:x1874711826004736:12345-192.168.206.36@tcp:35:lfs.0 Request processed in 256us (641us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787864949.710054:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 7 00000100:00100000:3.0:1787864949.858709:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.858762:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.858811:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.858846:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.858868:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.858930:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826005120 00000100:00100000:3.0:1787864949.858939:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826005120 00000100:00100000:3.0:1787864949.859007:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826005376 00000100:00100000:3.0:1787864949.859011:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826005376 00000100:00100000:1.0:1787864949.859016:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004992 00000100:00100000:1.0:1787864949.859023:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004992 00000100:00100000:3.0:1787864949.859030:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826005248 00000100:00100000:3.0:1787864949.859034:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826005248 00000100:00100000:3.0:1787864949.859059:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:3.0:1787864949.859068:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:510ff884-8326-4099-a028-24c7f160ea8a+5:2408:x1874711826005120:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:3.0:1787864949.859777:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:510ff884-8326-4099-a028-24c7f160ea8a+5:2408:x1874711826005120:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 706us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864949.859820:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826004864 00000100:00100000:0.0:1787864949.859851:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826004864 00000100:00100000:0.0:1787864949.859950:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 163 00000100:00100000:0.0:1787864949.859972:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:2408:x1874711826004864:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:0.0:1787864949.860046:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d616e35a-a6b8-4ca2-b094-37881626c931+13:2408:x1874711826004864:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 87us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864949.860053:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 163 00000100:00100000:1.0:1787864949.860256:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:1.0:1787864949.860272:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2408:x1874711826005376:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864949.860319:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2408:x1874711826005376:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 54us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.860327:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:1.0:1787864949.860346:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864949.860353:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:510ff884-8326-4099-a028-24c7f160ea8a+5:2408:x1874711826004992:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864949.860378:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:510ff884-8326-4099-a028-24c7f160ea8a+5:2408:x1874711826004992:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 25us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.860383:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:1.0:1787864949.860396:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864949.860403:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2408:x1874711826005248:12345-192.168.206.36@tcp:400:kworker.0 00000100:00100000:1.0:1787864949.860426:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5cd4de9c-d7d9-42bd-8973-32c51c2c9fe4+5:2408:x1874711826005248:12345-192.168.206.36@tcp:400:kworker.0 Request processed in 23us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.860432:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:3.0:1787864949.860465:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00080000:1.0:1787864949.864408:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787864949.864418:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787864949.982606:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864949.982844:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826005632 00000100:00100000:3.0:1787864949.982853:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826005632 00000100:00100000:3.0:1787864949.982997:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:3.0:1787864949.983007:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+21:15656:x1874711826005632:12345-192.168.206.36@tcp:101:cat.0 00010000:00010000:3.0:1787864949.983028:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787864949.983049:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc44ade lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace5d expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.983157:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44ae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.983170:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.983192:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787864949.983218:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787864949.983340:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030200/0x2fcb8c294dc44ade lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace5d expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.983359:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace5d expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864949.983368:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864949.983371:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787864949.983374:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927540031800, rc 0) 00000100:00100000:3.0:1787864949.983435:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+23:15656:x1874711826005632:12345-192.168.206.36@tcp:101:cat.0 Request processed in 430us (838us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787864949.983442:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 42 00000100:00100000:3.0:1787864949.986872:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864949.988431:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826005760 00000100:00100000:1.0:1787864949.988443:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826005760 00000100:00100000:0.0:1787864949.988526:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864949.988583:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006016 00000100:00100000:2.0:1787864949.988588:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006016 00000100:00100000:2.0:1787864949.988634:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:2.0:1787864949.988644:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:510ff884-8326-4099-a028-24c7f160ea8a+24:15656:x1874711826006016:12345-192.168.206.36@tcp:35:cat.0 00000100:00100000:2.0:1787864949.988920:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:510ff884-8326-4099-a028-24c7f160ea8a+25:15656:x1874711826006016:12345-192.168.206.36@tcp:35:cat.0 Request processed in 277us (395us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787864949.988930:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 8 00000100:00100000:1.0:1787864949.990231:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:1.0:1787864949.990260:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:510ff884-8326-4099-a028-24c7f160ea8a+24:2410:x1874711826005760:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864949.990275:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864949.990297:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540031800/0x2fcb8c294dc44ae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace5d expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864949.990314:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:1.0:1787864949.990319:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787864949.990376:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:510ff884-8326-4099-a028-24c7f160ea8a+23:2410:x1874711826005760:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 121us (3513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864949.990385:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:1.0:1787864950.041078:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787864950.041100:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844944512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787864950.041166:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787864950.042258:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787864950.042794:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844944512 00000100:00100000:0.0:1787864950.042802:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844944512 00000100:00100000:0.0:1787864950.042867:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787864950.042876:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844944512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787864950.042936:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1787864950.043038:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844944512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864950.043045:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787864950.043108:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844944512:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787864950.045049:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787864950.055930:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864950.056534:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006272 00000100:00100000:1.0:1787864950.056544:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006272 00000100:00100000:1.0:1787864950.056608:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:1.0:1787864950.056619:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+23:15662:x1874711826006272:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:1.0:1787864950.056641:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864950.056662:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44af3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace64 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056763:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056777:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056804:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056813:0:18198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056846:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.056860:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864950.056873:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844944640:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864950.057018:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 24 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864950.057027:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 24 pid: 17083 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864950.057036:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbc780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844944768:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864950.057060:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757daa8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787864950.062287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864950.062374:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006528 00000100:00100000:2.0:1787864950.062383:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006528 00010000:00010000:2.0:1787864950.062435:0:17067:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 25 pid: 17083 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864950.062477:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:2.0:1787864950.062487:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+25:2410:x1874711826006528:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864950.062501:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864950.062508:0:17067:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 25 pid: 17083 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.062519:0:17067:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 25 pid: 17083 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.062540:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864950.062550:0:17067:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.062567:0:17067:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.062572:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864950.062624:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+25:2410:x1874711826006528:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 139us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864950.062631:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 17 00000100:00100000:1.0:1787864950.063070:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844944640:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864950.063084:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44a98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace41 expref: 24 pid: 17083 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864950.063113:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbc780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844944768:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864950.063133:0:18198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864950.063430:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864950.063540:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006400 00000100:00100000:3.0:1787864950.063546:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006400 00010000:00010000:3.0:1787864950.063720:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864950.063754:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 18 00000100:00100000:3.0:1787864950.063763:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927447c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+24:2409:x1874711826006400:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864950.063773:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864950.063779:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.063802:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.063818:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44aad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace48 expref: 24 pid: 17082 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.063830:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864950.063835:0:17068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.063842:0:17068:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.063848:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864950.064071:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787864950.064118:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927447c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+23:2409:x1874711826006400:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 356us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864950.064126:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 18 00010000:00010000:0.0:1787864950.065082:0:18198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.065094:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787864950.065113:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787864950.065622:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797800/0x2fcb8c294dc44af3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace64 expref: 24 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.065660:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446797c00/0x2fcb8c294dc44afa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace64 expref: 23 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.065668:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:0.0:1787864950.065671:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787864950.065675:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446797c00, rc 0) 00000100:00100000:0.0:1787864950.065794:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+23:15662:x1874711826006272:12345-192.168.206.36@tcp:101:dd.0 Request processed in 9176us (9871us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787864950.065803:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 43 00000100:00100000:0.0:1787864950.069700:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864950.069851:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006656 00000100:00100000:2.0:1787864950.069860:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006656 00000100:00100000:2.0:1787864950.070070:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:2.0:1787864950.070081:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+23:15662:x1874711826006656:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:2.0:1787864950.070104:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864950.070135:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b08 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace6b expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070169:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070182:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070194:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070445:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 25 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070461:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 24 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.070469:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864950.070472:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864950.070476:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb400, rc 0) 00000100:00100000:2.0:1787864950.070574:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+24:15662:x1874711826006656:12345-192.168.206.36@tcp:101:dd.0 Request processed in 495us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864950.070581:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 44 00000100:00100000:2.0:1787864950.074110:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864950.074215:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826006912 00000100:00100000:0.0:1787864950.074224:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826006912 00000100:00100000:0.0:1787864950.074291:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 45 00000100:00100000:0.0:1787864950.074301:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+24:15662:x1874711826006912:12345-192.168.206.36@tcp:36:dd.0 00010000:00010000:0.0:1787864950.074514:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.074531:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.074542:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787864950.074583:0:17083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787864950.074606:0:17083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eabbe3ef reply state 00000000fc57f0c1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.074636:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.074643:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:0.0:1787864950.074646:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787864950.074650:0:17083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787864950.074735:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826006912:12345-192.168.206.36@tcp:36:dd.0 Request processed in 435us (634us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787864950.074743:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 45 00000020:00080000:0.0:1787864950.074747:0:17083:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787864950.077335:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864950.077394:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007040 00000100:00100000:2.0:1787864950.077402:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007040 00000100:00100000:2.0:1787864950.077460:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:2.0:1787864950.077479:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826007040:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:2.0:1787864950.077514:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864950.077533:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace72 expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.077588:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace72 expref: 28 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.077603:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b1d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace72 expref: 28 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.077620:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864950.077623:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864950.077627:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb800, rc 0) 00000100:00100000:2.0:1787864950.077821:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+28:15662:x1874711826007040:12345-192.168.206.36@tcp:101:dd.0 Request processed in 351us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864950.077828:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 46 00000100:00100000:3.0:1787864950.094276:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864950.094503:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007296 00000100:00100000:2.0:1787864950.094511:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007296 00000100:00100000:2.0:1787864950.094574:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:2.0:1787864950.094584:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+28:15662:x1874711826007296:12345-192.168.206.36@tcp:103:dd.0 00010000:00010000:2.0:1787864950.094599:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864950.094622:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace72 expref: 28 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.094641:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864950.094645:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864950.094702:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826007296:12345-192.168.206.36@tcp:103:dd.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864950.094723:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 2 00000100:00100000:1.0:1787864950.097354:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864950.097489:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007424 00000100:00100000:0.0:1787864950.097498:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007424 00000100:00100000:0.0:1787864950.097549:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:0.0:1787864950.097558:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826007424:12345-192.168.206.36@tcp:58:dd.0 00010000:00010000:0.0:1787864950.097650:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.097666:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864950.097678:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787864950.098755:0:17083:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787864950.098785:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787864950.099330:0:17083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787864950.099474:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826007424:12345-192.168.206.36@tcp:58:dd.0 Request processed in 1905us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864950.099485:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 47 00000100:00100000:0.0:1787864950.104207:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864950.104283:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007552 00000100:00100000:2.0:1787864950.104292:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007552 00000100:00100000:2.0:1787864950.104345:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 48 00000100:00100000:2.0:1787864950.104355:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+27:15662:x1874711826007552:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:2.0:1787864950.104375:0:17081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864950.104395:0:17081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace79 expref: -99 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104460:0:17081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104484:0:17081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 28 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104502:0:17081:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104515:0:17081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 28 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104528:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864950.104531:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787864950.104534:0:17081:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 28 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864950.104542:0:17081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb800, rc 0) 00000100:00100000:2.0:1787864950.104607:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+28:15662:x1874711826007552:12345-192.168.206.36@tcp:101:dd.0 Request processed in 253us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864950.104614:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 48 00000040:00080000:1.0:1787864950.105651:0:17835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787864950.681109:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864951.065263:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787864951.065336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864951.065380:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787864951.065386:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274491bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844945024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787864951.065409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864951.065455:0:18592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844944896 00000100:00100000:3.0:1787864951.065462:0:18592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844944896 00000100:00100000:0.0:1787864951.065472:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945024 00000100:00100000:0.0:1787864951.065478:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945024 00000100:00100000:3.0:1787864951.065517:0:18592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000040:00080000:2.0:1787864951.065635:0:17117:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787864951.065639:0:17117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787864951.065751:0:18592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844944896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787864951.065773:0:18592:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1787864951.065820:0:18592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844944896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 295us (484us total) trans 0 rc 0/0 00000040:00080000:2.0:1787864951.065858:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787864951.065865:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787864951.065990:0:17117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17117:1874711844945152:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864951.066066:0:17117:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787864951.066181:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787864951.066186:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787864951.066228:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844944896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787864951.066337:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844945280:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066367:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066384:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844945792:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066408:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066425:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066455:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066482:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787864951.066488:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844945408:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066510:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066526:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844945920:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066547:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066562:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844946432:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.066587:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.066625:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844945536:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.066629:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945792 00000100:00100000:1.0:1787864951.066635:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945792 00000100:00100000:2.0:1787864951.066655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864951.066666:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945408 00000100:00100000:1.0:1787864951.066670:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945408 00000100:00100000:1.0:1787864951.066684:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787864951.066691:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844945792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.066754:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844945792:12345-0@lo:400:kworker.0 Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.066761:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787864951.066940:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844946048:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.066977:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864951.066979:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864951.066992:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844945408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.067062:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844946560:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.067102:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787864951.067106:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874711844945408:12345-0@lo:400:kworker.0 Request processed in 42us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.067116:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787864951.067130:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787864951.067139:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844945664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067141:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945920 00000100:00100000:1.0:1787864951.067152:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945920 00000100:00100000:2.0:1787864951.067166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.067181:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844946176:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067192:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945536 00000100:00100000:1.0:1787864951.067197:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945536 00000100:00100000:2.0:1787864951.067206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.067221:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844946688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787864951.067224:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864951.067236:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844945920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.067251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.067282:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946304 00000100:00100000:1.0:1787864951.067284:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874711844945920:12345-0@lo:400:kworker.0 Request processed in 50us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.067286:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946304 00000100:00100000:1.0:1787864951.067295:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787864951.067311:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864951.067315:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946432 00000100:00100000:2.0:1787864951.067321:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946432 00000100:00100000:1.0:1787864951.067321:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844945536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.067339:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946048 00000100:00100000:2.0:1787864951.067342:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946048 00000100:00100000:2.0:1787864951.067352:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946560 00000100:00100000:2.0:1787864951.067355:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946560 00000100:00100000:2.0:1787864951.067368:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945664 00000100:00100000:2.0:1787864951.067370:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945664 00000100:00100000:1.0:1787864951.067391:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844945536:12345-0@lo:400:kworker.0 Request processed in 72us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.067399:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787864951.067404:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844945536:0@lo:400:kworker.0 00000100:00080000:1.0:1787864951.067421:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787864951.067426:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787864951.067429:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946176 00000100:00080000:1.0:1787864951.067430:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787864951.067434:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946176 00000100:00100000:2.0:1787864951.067460:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864951.067461:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3637:1874711844945408:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.067470:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844946304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067488:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844945920:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067498:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3637:1874711844945792:0@lo:400:kworker.0 00000100:00080000:1.0:1787864951.067516:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787864951.067531:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864951.067538:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844946432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067572:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874711844946432:12345-0@lo:400:kworker.0 Request processed in 35us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.067579:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864951.067602:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3637:1874711844946432:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067626:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787864951.067632:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.067664:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874711844946048:12345-0@lo:400:kworker.0 Request processed in 32us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.067669:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787864951.067680:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864951.067686:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844946560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068409:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874711844946560:12345-0@lo:400:kworker.0 Request processed in 719us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.068418:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787864951.068436:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787864951.068442:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844945664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068473:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874711844945664:12345-0@lo:400:kworker.0 Request processed in 32us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.068479:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787864951.068490:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864951.068496:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068523:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874711844946176:12345-0@lo:400:kworker.0 Request processed in 27us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.068529:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787864951.068564:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874711844945664:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068577:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3639:1874711844946176:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068587:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874711844946048:0@lo:400:kworker.0 00010000:00080000:1.0:1787864951.068612:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcda40 x1874711844946560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787864951.068622:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3639:1874711844946560:0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068670:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844945280 00000100:00100000:1.0:1787864951.068675:0:17075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844945280 00000100:00100000:1.0:1787864951.068714:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787864951.068721:0:17075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3637:x1874711844945280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787864951.068756:0:17075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92744821c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af099440-ba6e-4600-a03b-1ca45ea8912e+24:3637:x1874711844945280:12345-0@lo:400:kworker.0 Request processed in 36us (2388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.068763:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787864951.069135:0:18592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787864951.069154:0:18593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946688 00000100:00100000:0.0:1787864951.069160:0:18593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946688 00000100:00100000:0.0:1787864951.069183:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864951.069190:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844945024:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787864951.069225:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:af099440-ba6e-4600-a03b-1ca45ea8912e:3637:1874711844945280:0@lo:400:kworker.0 00000100:00100000:3.0:1787864951.069230:0:18592:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787864951.069240:0:18592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787864951.069662:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874711844946304:12345-0@lo:400:kworker.0 Request processed in 2193us (3204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.069670:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00002000:00000024:0.0:1787864951.069740:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864951.069794:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874711844945024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 604us (4383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864951.069802:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787864951.069817:0:18593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787864951.069824:0:18593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844946688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787864951.069833:0:18593:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1787864951.069858:0:18593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844946688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (2608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864951.069864:0:18593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787864951.069921:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff927548dcf840 x1874711844946304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787864967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787864951.069933:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3637:1874711844946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787864951.070187:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844946688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787864951.070211:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274491bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3639:1874711844945024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787864951.075664:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.075741:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007680 00000100:00100000:1.0:1787864951.075750:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007680 00000100:00100000:1.0:1787864951.075830:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00100000:1.0:1787864951.075839:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826007680:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787864951.075867:0:18198:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787864951.076042:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826007680:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 204us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.076049:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 49 00000100:00080000:3.0:1787864951.076402:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787864951.076568:0:17117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490d03c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17117:1874711844945152:192.168.206.36@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787864951.085296:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.085486:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826007808 00000100:00100000:1.0:1787864951.085494:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826007808 00000100:00100000:1.0:1787864951.085549:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:1.0:1787864951.085559:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+28:15663:x1874711826007808:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787864951.085809:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.085837:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.085863:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.085967:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.085975:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.085982:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086004:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086013:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086020:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864951.086354:0:17082:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787864951.086359:0:17082:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864951.086457:0:17082:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086469:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086490:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086496:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086503:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796000 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864951.086507:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086515:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086527:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927448157a00) 00010000:00010000:1.0:1787864951.086530:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864951.086535:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086541:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44b32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086553:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086559:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086564:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086569:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864951.086578:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086584:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086592:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff92744810a500) 00010000:00010000:1.0:1787864951.086594:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864951.086597:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.086603:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087511:0:17082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087522:0:17082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087529:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087535:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:1.0:1787864951.087538:0:17082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087545:0:17082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087555:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:1.0:1787864951.087557:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787864951.087571:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.087578:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.088393:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+28:15663:x1874711826007808:12345-192.168.206.36@tcp:34:lhsmtool_posix.0 Request processed in 2829us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.088403:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 50 00000100:00100000:1.0:1787864951.092513:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.092618:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826008064 00000100:00100000:2.0:1787864951.092627:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826008064 00000100:00100000:2.0:1787864951.092723:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:2.0:1787864951.092873:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+28:15663:x1874711826008064:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864951.092930:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864951.092961:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace80 expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093070:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093086:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093097:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787864951.093109:0:18198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787864951.093179:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093202:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093215:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093221:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.093224:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093232:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093245:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864951.093248:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787864951.093252:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093259:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093296:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b47 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace80 expref: 30 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093305:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff927448157a00) 00010000:00010000:2.0:1787864951.093307:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787864951.093311:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace80 expref: 30 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.093320:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bbc00, rc 0) 00000100:00100000:2.0:1787864951.093389:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826008064:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 520us (885us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787864951.093396:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 51 00000100:00100000:3.0:1787864951.100389:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.100463:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826008192 00000100:00100000:2.0:1787864951.100472:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826008192 00000100:00100000:2.0:1787864951.100530:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:2.0:1787864951.100541:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826008192:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787864951.100576:0:17081:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787864951.100729:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826008192:12345-192.168.206.36@tcp:53:lhsmtool_posix.0 Request processed in 190us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.100737:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 52 00000100:00100000:3.0:1787864951.109996:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864951.110270:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826008448 00000100:00100000:0.0:1787864951.110279:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826008448 00000100:00100000:0.0:1787864951.110456:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:0.0:1787864951.110467:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+29:15663:x1874711826008448:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864951.110491:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864951.110511:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace87 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787864951.110880:0:17083:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1787864951.110916:0:17083:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787864951.110937:0:17083:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787864951.111101:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44b63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.111127:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44b63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.111139:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44b63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.111192:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace87 expref: 32 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.111210:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44b63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace87 expref: 31 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.111218:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927548d9c200) 00010000:00010000:0.0:1787864951.111221:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787864951.111225:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bb000, rc 0) 00000100:00100000:0.0:1787864951.111291:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+31:15663:x1874711826008448:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 826us (1303us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787864951.111300:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 53 00000100:00100000:3.0:1787864951.115256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.115438:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826008704 00000100:00100000:2.0:1787864951.115447:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826008704 00000100:00100000:2.0:1787864951.115571:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:2.0:1787864951.115582:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+31:15663:x1874711826008704:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787864951.115636:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864951.115662:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb000/0x2fcb8c294dc44b63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace87 expref: 31 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115681:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927548d9c200) 00010000:00010000:2.0:1787864951.115691:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864951.115713:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115725:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115736:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115765:0:17081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115773:0:17081:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115780:0:17081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115819:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115826:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115832:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115838:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bbc00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.115842:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115862:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115870:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864951.115873:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864951.115877:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115883:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bbc00/0x2fcb8c294dc44b71 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115960:0:17081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115967:0:17081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115972:0:17081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115978:0:17081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.115981:0:17081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115987:0:17081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.115996:0:17081:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xea754841 (ffff927448157b00) 00010000:00010000:2.0:1787864951.116003:0:17081:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864951.116007:0:17081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.116012:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba200/0x2fcb8c294dc44b78 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xea754841 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.116161:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:510ff884-8326-4099-a028-24c7f160ea8a+30:15663:x1874711826008704:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 580us (922us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787864951.116168:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 54 00000100:00100000:3.0:1787864951.122799:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.122883:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826008832 00000100:00100000:2.0:1787864951.122923:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826008832 00000100:00100000:2.0:1787864951.122984:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:2.0:1787864951.123006:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+30:15663:x1874711826008832:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787864951.123024:0:18198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787864951.123046:0:18198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44b7f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace8e expref: -99 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.123264:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44b86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.123276:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.123287:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44b86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.127475:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44b7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace8e expref: 32 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.127504:0:18198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb000/0x2fcb8c294dc44b86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace8e expref: 31 pid: 18198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.127513:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:2.0:1787864951.127516:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864951.127601:0:18198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92757f7bb000, rc 0) 00000100:00100000:2.0:1787864951.127682:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+31:15663:x1874711826008832:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 4677us (4891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.127691:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 55 00000100:00100000:3.0:1787864951.132112:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.132225:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009088 00000100:00100000:1.0:1787864951.132236:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009088 00000100:00100000:1.0:1787864951.132296:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:1.0:1787864951.132306:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+31:15663:x1874711826009088:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787864951.132390:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.132407:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.132420:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787864951.132578:0:17082:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787864951.132587:0:17082:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476194698104ns, next at 477194696049ns, rc = 0 00000004:00010000:1.0:1787864951.132634:0:17082:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d7b2511 reply state 00000000913411d2 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.132647:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.132671:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:1.0:1787864951.132674:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787864951.132678:0:17082:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787864951.132776:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+33:15663:x1874711826009088:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 471us (673us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787864951.132783:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 56 00000100:00100000:3.0:1787864951.136204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864951.136288:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009216 00000100:00100000:0.0:1787864951.136298:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009216 00000100:00100000:0.0:1787864951.136352:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:0.0:1787864951.136369:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+33:15663:x1874711826009216:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787864951.136391:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787864951.136410:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace95 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.136462:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 34 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.136494:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 34 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.136512:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:0.0:1787864951.136515:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787864951.136518:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92754c5bba00, rc 0) 00000100:00100000:0.0:1787864951.136583:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+34:15663:x1874711826009216:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 223us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864951.136593:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 57 00000100:00100000:3.0:1787864951.141618:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864951.141718:0:19485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009344 00000100:00100000:0.0:1787864951.141728:0:19485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009344 00000100:00100000:0.0:1787864951.141797:0:19485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:0.0:1787864951.141808:0:19485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:510ff884-8326-4099-a028-24c7f160ea8a+5:2409:x1874711826009344:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787864951.141930:0:17077:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787864951.142489:0:19485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491b8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:510ff884-8326-4099-a028-24c7f160ea8a+6:2409:x1874711826009344:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 680us (876us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787864951.142500:0:19485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:3.0:1787864951.149267:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.149385:0:17085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009600 00000100:00100000:2.0:1787864951.149394:0:17085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009600 00000100:00100000:2.0:1787864951.149475:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:2.0:1787864951.149497:0:17085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:510ff884-8326-4099-a028-24c7f160ea8a+34:15663:x1874711826009600:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787864951.149709:0:17085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274491bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:510ff884-8326-4099-a028-24c7f160ea8a+35:15663:x1874711826009600:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 213us (450us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787864951.149716:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 9 00000100:00100000:3.0:1787864951.152430:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.152685:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009856 00000100:00100000:1.0:1787864951.152694:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009856 00000100:00100000:1.0:1787864951.152753:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:1.0:1787864951.152762:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+35:15663:x1874711826009856:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864951.153003:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927446fa4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+35:15663:x1874711826009856:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 240us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.153011:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 58 00000100:00100000:0.0:1787864951.158804:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.158918:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826009984 00000100:00100000:1.0:1787864951.158927:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826009984 00000100:00100000:1.0:1787864951.158995:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:1.0:1787864951.159005:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+35:15663:x1874711826009984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864951.159022:0:17083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864951.159041:0:17083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6ace9c expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159102:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159128:0:17083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159139:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787864951.159179:0:17083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787864951.159201:0:17083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159225:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796400/0x2fcb8c294dc44b9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace9c expref: 37 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159241:0:17083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace9c expref: 36 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.159250:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:1.0:1787864951.159252:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787864951.159255:0:17083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796000, rc 0) 00000100:00100000:1.0:1787864951.159316:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+36:15663:x1874711826009984:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 312us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.159324:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 59 00000100:00100000:3.0:1787864951.165059:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.165149:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826010112 00000100:00100000:1.0:1787864951.165159:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826010112 00000100:00100000:1.0:1787864951.165262:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:1.0:1787864951.165272:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757c3a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:510ff884-8326-4099-a028-24c7f160ea8a+6:2410:x1874711826010112:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787864951.165290:0:18591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864951.165320:0:18591:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6acea3 expref: -99 pid: 18591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787864951.165345:0:18591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90a776, blocks: 0x0 00010000:00010000:1.0:1787864951.165363:0:18591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1787864951.165367:0:18591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787864951.165377:0:18591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 7 pid: 18591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.165396:0:18591:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 7 pid: 18591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.165410:0:18591:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796e00, rc 0) 00000100:00100000:1.0:1787864951.165480:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757c3a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:510ff884-8326-4099-a028-24c7f160ea8a+7:2410:x1874711826010112:12345-192.168.206.36@tcp:101:lhsmtool_posix.0 Request processed in 210us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.165487:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 22 00000100:00100000:3.0:1787864951.168986:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.169104:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826010368 00000100:00100000:1.0:1787864951.169112:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826010368 00000100:00100000:1.0:1787864951.169169:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:1.0:1787864951.169177:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+36:15663:x1874711826010368:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787864951.169272:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+36:15663:x1874711826010368:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.169279:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 60 00000100:00100000:0.0:1787864951.178850:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.179298:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826010496 00000100:00100000:1.0:1787864951.179307:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826010496 00000100:00100000:1.0:1787864951.179368:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 61 00000100:00100000:1.0:1787864951.179378:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+36:15663:x1874711826010496:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787864951.181438:0:17061:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787864951.181452:0:17061:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787864951.181506:0:17061:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1787864951.181637:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:510ff884-8326-4099-a028-24c7f160ea8a+19:15663:x1874711826010496:12345-192.168.206.36@tcp:44:lhsmtool_posix.0 Request processed in 2257us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.181647:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 61 00010000:00010000:2.0:1787864951.182402:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182414:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182422:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182429:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bae00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.182433:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182441:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182457:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:2.0:1787864951.182460:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787864951.182465:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.182472:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44a36 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.182826:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787864951.182843:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92755883ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844946816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787864951.182967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.183011:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844946816 00000100:00100000:2.0:1787864951.183018:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844946816 00000100:00100000:2.0:1787864951.183057:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787864951.183067:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844946816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787864951.183192:0:18590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787864951.183195:0:18590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787864951.183198:0:18590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787864951.183200:0:18590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787864950 -> 1787864950 00002000:00010000:2.0:1787864951.183202:0:18590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787864951.183237:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874711844946816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (270us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787864951.183244:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1787864951.183297:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92755883ed00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1787864951.183303:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92755883ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844946816:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787864951.185805:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185833:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185840:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185846:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.185850:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185857:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185871:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff927448157200) 00010000:00010000:3.0:1787864951.185874:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864951.185878:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185884:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba400/0x2fcb8c294dc449e2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185921:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185928:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185934:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185939:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.185947:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185965:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185973:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff927448157500) 00010000:00010000:3.0:1787864951.185976:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864951.185979:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185984:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb600/0x2fcb8c294dc449e9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17081 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.185997:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186003:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186063:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186069:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7ba600 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.186072:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186078:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186087:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff927448157300) 00010000:00010000:3.0:1787864951.186090:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864951.186099:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186105:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7ba600/0x2fcb8c294dc44a91 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186124:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186130:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186135:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186140:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb400 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.186143:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186149:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186157:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864951.186159:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787864951.186163:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186169:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb400/0x2fcb8c294dc44b16 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186179:0:3623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186193:0:3623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186199:0:3623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186204:0:3623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796800 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.186217:0:3623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186223:0:3623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186231:0:3623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:3.0:1787864951.186233:0:3623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787864951.186336:0:3623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.186345:0:3623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796800/0x2fcb8c294dc44b8d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864951.186947:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.187034:0:18740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826010624 00000100:00100000:2.0:1787864951.187042:0:18740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826010624 00000100:00100000:2.0:1787864951.187100:0:18740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:2.0:1787864951.187109:0:18740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+7:2409:x1874711826010624:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787864951.187233:0:18740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490ca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:510ff884-8326-4099-a028-24c7f160ea8a+7:2409:x1874711826010624:12345-192.168.206.36@tcp:16:lhsmtool_posix.0 Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.187240:0:18740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 24 00000100:00100000:1.0:1787864951.191516:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864951.191603:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826010880 00000100:00100000:3.0:1787864951.191612:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826010880 00000100:00100000:3.0:1787864951.191670:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 62 00000100:00100000:3.0:1787864951.191682:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+15:15663:x1874711826010880:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787864951.191732:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864951.191759:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796000/0x2fcb8c294dc44ba2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace9c expref: 15 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.191794:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:3.0:1787864951.191799:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787864951.191831:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44bb0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.191843:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.191854:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787864951.192000:0:17082:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004562a73a reply state 00000000c0b892be transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44bb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.192013:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927540030e00/0x2fcb8c294dc44bb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.192020:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:3.0:1787864951.192022:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787864951.192025:0:17082:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787864951.192134:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+16:15663:x1874711826010880:12345-192.168.206.36@tcp:36:lhsmtool_posix.0 Request processed in 454us (624us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787864951.192142:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 62 00000100:00100000:0.0:1787864951.201349:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.201548:0:19486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011008 00000100:00100000:2.0:1787864951.201557:0:19486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011008 00000100:00100000:2.0:1787864951.201614:0:19486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:2.0:1787864951.201624:0:19486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+7:2410:x1874711826011008:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787864951.201772:0:19486:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787864951.201776:0:19486:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787864949 00002000:00010000:2.0:1787864951.201779:0:19486:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787864949 00002000:00010000:2.0:1787864951.201781:0:19486:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787864950 -> 1787864949 00002000:00010000:2.0:1787864951.201783:0:19486:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787864951.201847:0:19486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:510ff884-8326-4099-a028-24c7f160ea8a+8:2410:x1874711826011008:12345-192.168.206.36@tcp:2:lhsmtool_posix.0 Request processed in 224us (505us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787864951.201854:0:19486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 25 00000100:00100000:0.0:1787864951.205485:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.205971:0:18590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011136 00000100:00100000:2.0:1787864951.205980:0:18590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011136 00000100:00100000:2.0:1787864951.206040:0:18590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:2.0:1787864951.206050:0:18590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:510ff884-8326-4099-a028-24c7f160ea8a+8:2408:x1874711826011136:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787864951.206090:0:18590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206107:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.206112:0:18590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.206128:0:18590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206141:0:18590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206174:0:18590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206201:0:18590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206210:0:18590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206218:0:18590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bae00 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864951.206221:0:18590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206231:0:18590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206246:0:18590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.206254:0:18590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0fd829d/0x2fcb8c294dc44bb7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.206330:0:18590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:510ff884-8326-4099-a028-24c7f160ea8a+8:2408:x1874711826011136:12345-192.168.206.36@tcp:1:lhsmtool_posix.0 Request processed in 282us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.206338:0:18590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 26 00000100:00100000:3.0:1787864951.210251:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.210582:0:18198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011392 00000100:00100000:2.0:1787864951.210591:0:18198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011392 00000100:00100000:2.0:1787864951.210754:0:18198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 63 00000100:00100000:2.0:1787864951.210778:0:18198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+16:15663:x1874711826011392:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787864951.210852:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.210868:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 16 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.210878:0:18198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.210948:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 16 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.210973:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 16 pid: 17081 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.210988:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844946944:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864951.211063:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787864951.217542:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864951.217616:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011520 00000100:00100000:3.0:1787864951.217625:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011520 00010000:00010000:3.0:1787864951.217668:0:17068:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 17 pid: 17081 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864951.217722:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 19 00000100:00100000:2.0:1787864951.217729:0:17067:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787864951.217735:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+17:2410:x1874711826011520:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787864951.217751:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787864951.217758:0:17068:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 17 pid: 17081 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217770:0:17068:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 17 pid: 17081 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217790:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864951.217796:0:17068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 17 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217805:0:17068:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217812:0:17068:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217818:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.217835:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864951.217842:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787864951.217913:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:510ff884-8326-4099-a028-24c7f160ea8a+17:2410:x1874711826011520:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 181us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864951.217920:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 19 00010000:00010000:1.0:1787864951.218431:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb400/0x2fcb8c294dc44b0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace6b expref: 16 pid: 17081 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.218446:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcd680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844946944:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864951.219266:0:18198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.219279:0:18198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.219285:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.220436:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.220456:0:18198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 16 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.220526:0:18198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.220633:0:18198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 16 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.220650:0:18198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 16 pid: 17083 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.220665:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844947072:192.168.206.36@tcp:104: 00000100:00100000:1.0:1787864951.220786:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff927449237900 going to sleep for 11 seconds 00000100:00100000:1.0:1787864951.223738:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844947072:192.168.206.36@tcp:104: 00010000:00010000:1.0:1787864951.223764:0:18198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864951.224098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.224198:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011648 00000100:00100000:1.0:1787864951.224204:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011648 00010000:00010000:1.0:1787864951.224236:0:17066:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 17 pid: 17083 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.224269:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 20 00000100:00100000:1.0:1787864951.224278:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:510ff884-8326-4099-a028-24c7f160ea8a+17:2409:x1874711826011648:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787864951.224293:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787864951.224300:0:17066:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 17 pid: 17083 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224312:0:17066:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 17 pid: 17083 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224354:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bba00/0x2fcb8c294dc44b94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace95 expref: 17 pid: 17083 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224368:0:17066:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:1.0:1787864951.224373:0:17066:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224383:0:17066:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224391:0:17066:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.224418:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787864951.224452:0:18198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.224470:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:510ff884-8326-4099-a028-24c7f160ea8a+16:2409:x1874711826011648:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 193us (372us total) trans 0 rc 0/0 00010000:00010000:2.0:1787864951.224472:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.224483:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 20 00000001:00080000:2.0:1787864951.224590:0:18198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787864951.224700:0:18198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787864951.224734:0:18198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787864951.224806:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18198:1874711844947200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787864951.224877:0:18198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.224943:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff9274471d9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864951.225133:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844947200 00000100:00100000:1.0:1787864951.225138:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844947200 00000100:00100000:1.0:1787864951.225173:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787864951.225192:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18198:x1874711844947200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787864951.225268:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18198:x1874711844947200:12345-0@lo:1000:mdt00_003.0 Request processed in 87us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787864951.225274:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787864951.225964:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18198:1874711844947200:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787864951.226307:0:18198:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787864951.226363:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18198:1874711844947328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787864951.226405:0:18198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787864951.226429:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757f7ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864951.226672:0:17822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844947328 00000100:00100000:1.0:1787864951.226678:0:17822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844947328 00000100:00100000:1.0:1787864951.226723:0:17822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787864951.226731:0:17822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18198:x1874711844947328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787864951.226852:0:17822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18198:x1874711844947328:12345-0@lo:1000:mdt00_003.0 Request processed in 122us (445us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787864951.226860:0:17822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787864951.227306:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dcf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18198:1874711844947328:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787864951.227345:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227354:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227361:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227367:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927446796c00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.227371:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227378:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227393:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:3.0:1787864951.227395:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864951.227399:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227405:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bc5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227433:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227439:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227443:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227456:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:3.0:1787864951.227459:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227465:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227475:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:3.0:1787864951.227477:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787864951.227483:0:18198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227492:0:18198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227501:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.227529:0:18198:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb800/0x2fcb8c294dc44b2b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6ace79 expref: 19 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864951.227542:0:18198:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9274490cb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844947456:192.168.206.36@tcp:105: 00000100:00100000:3.0:1787864951.228316:0:18198:0:(client.c:2715:ptlrpc_set_wait()) set ffff92757d864a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787864951.231480:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864951.231555:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011776 00000100:00100000:0.0:1787864951.231562:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011776 00000100:00100000:0.0:1787864951.231614:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:0.0:1787864951.231624:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+20:15662:x1874711826011776:12345-192.168.206.36@tcp:49:dd.0 00000100:00100000:0.0:1787864951.231741:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbb4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+20:15662:x1874711826011776:12345-192.168.206.36@tcp:49:dd.0 Request processed in 117us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864951.231749:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 10 00000100:00100000:2.0:1787864951.232473:0:18198:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9274490cb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18198:1874711844947456:192.168.206.36@tcp:105: 00010000:00010000:2.0:1787864951.232498:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232507:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5bb200/0x2fcb8c294dc44b24 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232535:0:18198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232548:0:18198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232558:0:18198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232567:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232573:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232579:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232593:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bae00 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.232597:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232604:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232616:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864951.232619:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787864951.232622:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232628:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bae00/0x2fcb8c294dc44bcc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232638:0:18198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232644:0:18198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232650:0:18198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232654:0:18198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb200 already unused, calling callback (ffffffffc19e44f0) 00010000:00010000:2.0:1787864951.232656:0:18198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232662:0:18198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232680:0:18198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:2.0:1787864951.232682:0:18198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787864951.232685:0:18198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.232691:0:18198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92757f7bb200/0x2fcb8c294dc44bbe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.232872:0:18198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:510ff884-8326-4099-a028-24c7f160ea8a+19:15663:x1874711826011392:12345-192.168.206.36@tcp:57:lhsmtool_posix.0 Request processed in 22096us (22629us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787864951.232880:0:18198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 63 00000020:00080000:2.0:1787864951.232884:0:18198:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787864951.234571:0:17117:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787864951.234578:0:17117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787864951.234605:0:17117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787864951.234750:0:17117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787864951.236094:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:1.0:1787864951.236386:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826011904 00000100:00100000:1.0:1787864951.236397:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826011904 00000100:00100000:3.0:1787864951.236402:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:0.0:1787864951.236486:0:17084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826012160 00000100:00100000:0.0:1787864951.236491:0:17084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826012160 00000100:00100000:0.0:1787864951.236528:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 11 00000100:00100000:0.0:1787864951.236536:0:17084:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+20:15663:x1874711826012160:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787864951.236565:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 64 00000100:00100000:1.0:1787864951.236578:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+20:15662:x1874711826011904:12345-192.168.206.36@tcp:101:dd.0 00010000:00010000:1.0:1787864951.236589:0:17082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787864951.236611:0:17082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446797400/0x2fcb8c294dc44bd3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdf3236a3ef6aceaa expref: -99 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236646:0:17082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bda lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236660:0:17082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236672:0:17082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bda lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236766:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff927446797400/0x2fcb8c294dc44bd3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aceaa expref: 23 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236783:0:17082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff927446796c00/0x2fcb8c294dc44bda lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6aceaa expref: 22 pid: 17082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787864951.236791:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff927448157e00) 00010000:00010000:1.0:1787864951.236794:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787864951.236804:0:17082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff927446796c00, rc 0) 00000004:00080000:0.0:1787864951.236863:0:17084:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787864951.237079:0:17084:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:1.0:1787864951.237105:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:510ff884-8326-4099-a028-24c7f160ea8a+23:15662:x1874711826011904:12345-192.168.206.36@tcp:101:dd.0 Request processed in 530us (1025us total) trans 0 rc 0/0 00010000:00010000:0.0:1787864951.237111:0:17084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787864951.237115:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 64 00010000:00010000:0.0:1787864951.237127:0:17084:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.237508:0:17084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.237517:0:17084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.237524:0:17084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.237531:0:17084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.237555:0:17084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787864951.237658:0:17084:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:510ff884-8326-4099-a028-24c7f160ea8a+22:15663:x1874711826012160:12345-192.168.206.36@tcp:35:lhsmtool_posix.0 Request processed in 1121us (1258us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787864951.237666:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 11 00000020:00080000:0.0:1787864951.237670:0:17084:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787864951.237729:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787864951.237736:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.237743:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92754c5ba400 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864951.237747:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.237755:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.237766:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff927448157800) 00010000:00010000:2.0:1787864951.237769:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787864951.237781:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.237788:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92754c5ba400/0x2fcb8c294dc44be1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17084 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.237810:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864951.237812:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787864951.237813:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787864951.386426:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.386835:0:18594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826012288 00000100:00100000:2.0:1787864951.386844:0:18594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826012288 00000100:00100000:2.0:1787864951.387230:0:18594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 0 00000100:00100000:2.0:1787864951.387242:0:18594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9274490c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:510ff884-8326-4099-a028-24c7f160ea8a+8:2408:x1874711826012288:12345-192.168.206.36@tcp:4:dd.0 00010000:00010000:2.0:1787864951.387275:0:18594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.387352:0:18594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 8 pid: 18591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.387363:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.387367:0:18594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.387372:0:18594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.387407:0:18594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 8 pid: 18591 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.387422:0:18594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 8 pid: 18591 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.387436:0:18594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff927548dced00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18594:1874711844947584:192.168.206.36@tcp:104: 00000100:00100000:2.0:1787864951.387539:0:18594:0:(client.c:2715:ptlrpc_set_wait()) set ffff927447e45cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787864951.390769:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:3.0:1787864951.391072:0:18596:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787864951.391081:0:18596:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787864951.394620:0:18596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826012416 00000100:00100000:1.0:1787864951.394633:0:18596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826012416 00000100:00100000:0.0:1787864951.394828:0:3630:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.36@tcp (source: 12345-192.168.206.36@tcp) 00000100:00100000:2.0:1787864951.399672:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711826012544 00000100:00100000:2.0:1787864951.399688:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711826012544 00010000:00010000:2.0:1787864951.399756:0:17067:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 10 pid: 18591 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.399806:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 21 00000100:00100000:2.0:1787864951.399815:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+10:2410:x1874711826012544:12345-192.168.206.36@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787864951.399831:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787864951.399852:0:17067:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 10 pid: 18591 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.399867:0:17067:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 10 pid: 18591 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864951.400150:0:18594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff927548dced00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18594:1874711844947584:192.168.206.36@tcp:104: 00010000:00010000:2.0:1787864951.400221:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091c90772/0x2fcb8c294dc44ba9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.36@tcp remote: 0xdf3236a3ef6acea3 expref: 10 pid: 18591 timeout: 576 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.400383:0:18594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.400432:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.400437:0:17067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787864951.400443:0:17067:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.400465:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.400539:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787864951.400638:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92755883f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:510ff884-8326-4099-a028-24c7f160ea8a+9:2410:x1874711826012544:12345-192.168.206.36@tcp:103:ldlm_bl.0 Request processed in 823us (5813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787864951.400647:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 21 00010000:00010000:0.0:1787864951.400741:0:18594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.400750:0:18594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787864951.406162:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.36@tcp, seq: 1 00000100:00100000:3.0:1787864951.406183:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:510ff884-8326-4099-a028-24c7f160ea8a+8:2407:x1874711826012416:12345-192.168.206.36@tcp:4:dd.0 00010000:00010000:3.0:1787864951.406225:0:20223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.406242:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864951.406247:0:20223:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787864951.406253:0:20223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787864951.406267:0:20223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787864951.479115:0:19401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1787864951.479139:0:19401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:0.0:1787864951.479359:0:18594:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1787864951.479365:0:18594:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1787864949 -> 1787864951 00002000:00010000:0.0:1787864951.479368:0:18594:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787864949 -> 1787864951 00002000:00010000:0.0:1787864951.479370:0:18594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1787864951.479390:0:18594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479406:0:18594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479415:0:18594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479423:0:18594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92757f7bb200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:0.0:1787864951.479429:0:18594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479439:0:18594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479493:0:18594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787864951.479503:0:18594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6e5f58/0x2fcb8c294dc44be8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787864951.479971:0:18594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9274490c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:510ff884-8326-4099-a028-24c7f160ea8a+7:2408:x1874711826012288:12345-192.168.206.36@tcp:4:dd.0 Request processed in 92711us (93533us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787864951.479996:0:18594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 0 00000001:00080000:0.0:1787864951.512121:0:19401:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787864951.512299:0:20223:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1787864951.512304:0:20223:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1787864951.512319:0:20223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512331:0:20223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512340:0:20223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512348:0:20223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff927540030200 already unused, calling callback (ffffffffc0dd8530) 00010000:00010000:2.0:1787864951.512353:0:20223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512361:0:20223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512380:0:20223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787864951.512401:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069fc14a5/0x2fcb8c294dc44bef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787864951.512495:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:510ff884-8326-4099-a028-24c7f160ea8a+5:2407:x1874711826012416:12345-192.168.206.36@tcp:4:dd.0 Request processed in 106316us (121729us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787864951.512505:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.36@tcp, seq: 1 00010000:00010000:2.0:1787864951.705177:0:17070:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787864952.089225:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92755883cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844947712:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787864952.089312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787864952.089368:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844947712 00000100:00100000:0.0:1787864952.089380:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844947712 00000100:00100000:0.0:1787864952.089447:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787864952.089460:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844947712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787864952.089504:0:17086:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787864952.089600:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff927548dced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874711844947712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787864952.089607:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787864952.089972:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92757dbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844947840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787864952.090234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92755883cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3638:1874711844947712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787864952.090513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787864952.090664:0:17087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874711844947840 00000100:00100000:3.0:1787864952.090673:0:17087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874711844947840 00000100:00100000:3.0:1787864952.090728:0:17087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787864952.090737:0:17087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844947840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787864952.090770:0:17087:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787864952.090852:0:17087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92757dbbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874711844947840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787864952.090859:0:17087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787864952.090928:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92757dbbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3639:1874711844947840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787864952.730969:0:18236:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787864952.795697:0:20261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787864953.755123:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 40830 lines, 40830 kept, 0 dropped, 0 bad.